Posted:
Job Description
Role: AWS Data Engineer
Location: Toronto(Hybrid)
Responsibilities:
- Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and other AWS services.
- Integrate structured and unstructured data from diverse sources into data lakes and warehouses (e.g., S3, Redshift, RDS, Athena).
- Build and maintain cloud infrastructure for data analytics platforms using Terraform, CloudFormation, or similar IaC tools.
- Develop reusable frameworks and automation scripts to streamline data operations.
- Collaborate with Data engineers, data scientists and analysts to deliver high-quality platform for Loading, reporting and machine learning.
- Optimize data models and queries for performance and scalability.
- Monitor data pipelines and troubleshoot issues to ensure reliability and data integrity.
- Implement Cloud development Kit, CI/CD pipelines for data engineering workflows using GitLab, Bitbucket, Jenkins, or GitHub Actions.
- Ensure compliance with data governance and security best practices.
- Implement access controls and encryption for sensitive data.
Preferred Skills:
- Experience with big data tools (Spark, Hive, Kafka Python, Typescript).
- Proficiency in Python, SQL, and PySpark.
- Hands-on experience with AWS services: S3, Glue, Lambda, Redshift, RDS, Athena, Step Functions.
- Experience with orchestration tools like Apache Airflow or MWAA.
- Familiarity with DevOps tools and practices (CDK,CI/CD, Git, Terraform).
- Strong understanding of data modeling, warehousing, and ETL processes.
- Knowledge of containerization (Docker, Kubernetes).
- Familiarity with data visualization tools ( Power BI).
- AWS certifications (e.g., AWS Certified Data Analytics - Specialty).
Regards
Praveen
Talent Acquisition Group - Strategic Recruitment Manager
Themesoft Inc