Data Automation Engineer
2 weeks ago
We are seeking a highly skilled Data Automation Engineer to join our dynamic team. The successful candidate will be responsible for automating data workflows, optimizing data collection, processing, and integration processes, and ensuring the scalability and efficiency of our data pipelines. You will work closely with data engineers, analysts, and IT teams to design and implement solutions that automate the flow of data across various systems and platforms.
Key Responsibilities:- Design, build, and maintain automated data pipelines to ingest, process, and transform data from various sources to support business analytics, reporting, and decision-making.
- Improve the efficiency and scalability of data workflows by automating repetitive tasks, such as data extraction, cleaning, and loading (ETL processes).
- Work closely with data scientists, analysts, and IT teams to ensure that data flows smoothly across the organization and is processed correctly.
- Develop automated validation checks and monitoring tools to ensure the quality and integrity of the data throughout the pipeline.
- Build and Maintain Documentation: Document automation processes, pipelines, and systems to ensure transparency and ease of understanding for stakeholders and future team members.
- Monitor and Troubleshoot Pipelines: Continuously monitor the performance of automated data pipelines and address any issues related to data quality, performance, or failures.
- Automate Data Reporting: Create automated solutions for generating and delivering reports, dashboards, or notifications to relevant stakeholders.
- Implement Best Practices: Follow and advocate for best practices in automation, data management, and security.
- Bachelor's Degree in Computer Science, Data Engineering, Information Technology, or related field (or equivalent experience).
- 3+ years of experience in data automation, data engineering, or related roles.
- Proficiency in Python or other scripting languages for data automation tasks.
- Experience with ETL tools (e.g., Apache Airflow, Talend, Informatica, or custom Python-based pipelines).
- Solid understanding of data storage technologies, such as relational databases (SQL), NoSQL, cloud storage, or data lakes.
- Familiarity with cloud platforms (AWS, Google Cloud, Microsoft Azure) and related data services (e.g., S3, BigQuery, Redshift).
- Experience with data processing frameworks like Apache Spark, Kafka, or Apache Beam is a plus.
- Strong knowledge of data integration tools and techniques.
- Ability to work with version control systems (e.g., Git) and CI/CD pipelines.
- Understanding of data governance and best practices for data security and privacy.
- Excellent problem-solving skills and the ability to troubleshoot complex data workflows.
- Strong communication skills and the ability to collaborate effectively with cross-functional teams.
- Experience with data visualization and reporting tools (e.g., Power BI, Tableau).
- Familiarity with containerization (Docker, Kubernetes) for deployment of data automation tools.
- Knowledge of machine learning workflows and automating data processes for ML model training and deployment is a plus.
Mid-Senior level
Employment typeContract
Job functionEngineering and Information Technology
IndustriesTelecommunications
#J-18808-Ljbffr-
Salesforce Automation Engineer
2 weeks ago
Toronto, Ontario, Canada NTT DATA North America Full timeAbout the Role:NNT DATA North America is seeking a highly skilled Salesforce QA Automation Engineer to join our team. As a key member of our Quality Assurance Test team, you will play a vital role in ensuring the digital technology and related services that we build for our clients are valuable, intuitive, and impactful.Key Responsibilities:1. Collaborate...
-
Senior Automation Engineer
2 weeks ago
Toronto, Ontario, Canada RBC Full timeAbout the RoleWe are looking for a Senior Automation Engineer with a strong background in Big Data technologies and automation tools to lead our QA efforts on Big Data projects. The ideal candidate will have a proven track record of leading QA teams and experience in designing and building robust automated testing frameworks.
-
Toronto, Ontario, Canada NTT DATA North America Full timeJob OverviewAs a Salesforce QA Automation Engineer at NTT DATA North America, you will play a critical role in ensuring the digital technology and related services we build for our clients are valuable, intuitive, and impactful. Your primary responsibility will be to create and execute test plans, report test status, and participate in team meetings.Key...
-
Salesforce Automation Engineer
4 days ago
Toronto, Ontario, Canada NTT DATA North America Full timeJob DescriptionNTT DATA North America is seeking a skilled Salesforce QA Automation Engineer to join our team. This position involves creating and executing test plans, reporting test status, and participating in team meetings.About the RoleWe are looking for a motivated individual with 5+ years of experience in quality assurance processes, software...
-
Industrial Automation Leader
1 week ago
Toronto, Ontario, Canada ATS Automation Full timeAbout UsWe are ATS Automation, a global enterprise with a proud history. Our Life Sciences Systems division provides custom-designed automated solutions for medical device and pharmaceutical companies.Job SummaryWe are seeking an experienced Electrical Engineering Manager to lead our hardware engineering team. The successful candidate will have a strong...
-
Automation and Control Specialist
1 week ago
Toronto, Ontario, Canada ATS Automation Full timeCareer OpportunityATS Automation is committed to innovation and continuous improvement. We offer a dynamic work environment where employees can grow and develop their skills.Job DescriptionThe Electrical Engineering Manager will be responsible for leading the hardware engineering team to design and implement control systems for industrial automation...
-
Salesforce QA Automation Engineer
3 weeks ago
Toronto, Ontario, Canada NTT DATA North America Full timeReq ID:312648NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Salesforce QA Automation Engineer - Remote Canada Position.Our Salesforce Quality Assurance Test teams are fundamental to...
-
Automated Test Engineer
2 weeks ago
Toronto, Ontario, Canada Cognizant Full timeWe're seeking a Senior SDET Quality Engineer with expertise in banking/finance automation to drive test efficiency. Key responsibilities include defining test strategies, creating test plans, executing test cases, and implementing automation solutions for our clients.About Cognizant's QA Practice:As the largest Quality Assurance Practice globally, we serve...
-
Toronto, Ontario, Canada MSI Corp Full timeAbout the RoleMSI Corp is seeking a skilled Data Automation Engineer to join our team. As a key member of our dynamic group, you will be responsible for designing and implementing automated data pipelines to support business analytics, reporting, and decision-making.Key Responsibilities:We are looking for a highly skilled professional to design, build, and...
-
Data Engineer
20 hours ago
Toronto, Ontario, Canada beBee Careers Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will design and develop scalable cloud-based solutions using Azure Data Engineering, Databricks, and Medallion Data Lakehouse architectures.Your primary responsibility will be to build, automate, and optimize ETL/ELT pipelines...
-
Data Pipeline Automation Expert
2 weeks ago
Toronto, Ontario, Canada Cpus Engineering Staffing Solutions Inc. Full timeAbout Cpus Engineering Staffing Solutions Inc.">We are a leading provider of staffing solutions in the field of engineering and technology. Our company is dedicated to connecting talented professionals with exciting opportunities that match their skills and interests.">Job Description">We are seeking a highly skilled DevOps Lead for Azure Environment to lead...
-
Automation Engineer Network Expertise
1 week ago
Toronto, Ontario, Canada NetBrain Technologies Inc. Full timeAbout the RoleWe are seeking an experienced Automation Engineer with expertise in network technologies to join our team as a Senior Network Automation Services Engineer. In this role, you will work closely with customers to identify high-impact automation targets for their network operations through analysis of IT service management data.You will design and...
-
Automation Engineer
2 hours ago
Toronto, Ontario, Canada beBee Careers Full timeAbout the RoleThis job is an exciting opportunity to work on ensuring the quality of our products. The Quality Engineering team works in partnership with other Technology Functions and the Business to ensure quality delivery of our products. The team works in an Agile environment and is located globally.The Main Responsibilities include:• Develop...
-
Data Engineer
1 day ago
Toronto, Ontario, Canada Toolbx US Inc. Full timeJob Description Job Description Salary: 80,000K to 130,000KJob Title: Data Engineer (Remote)Company: TOOLBXLocation: Toronto, Canada (Remote)Type: Full TimeWebsite:About TOOLBX:TOOLBX is on a mission to improve construction material supply chain productivity by simplifying how builders order building supplies and how dealers sell their products through one...
-
Azure Data Automation Specialist
3 days ago
Toronto, Ontario, Canada Global X Canada Full timeJob Description:We are seeking an experienced Azure Cloud specialist to join our Digital Innovation & Data Analytics team. As an Azure Cloud engineer, you will be responsible for designing, building, and managing Azure Data Factory (ADF) pipelines for robust ETL processes.You will develop automation workflows using Azure Logic Apps and Power Automate,...
-
Data Engineer
3 weeks ago
Toronto, Ontario, Canada Teamrecruiter Inc Full timeOur Banking client is looking for a Data Engineer (Capital Markets)Length: 12 months contract with the possibility of extension and conversion to full time employment Location: Toronto, ON (Hybrid) - 2 times per week in office (Tuesdays and Thursdays)Working Hours: 9 am to 5 pm Line of Business: Global Asset Management (GAM) - Business Analytics and...
-
Senior Test Automation Engineer
2 weeks ago
Toronto, Ontario, Canada Avensia Technologies Full timeJob Title: Senior Test Automation EngineerAbout the RoleWe are looking for an experienced Senior Test Automation Engineer to join our team at Avensia Technologies. The successful candidate will be responsible for developing and implementing testing protocols, reviewing data, and providing regular reports to senior management.The ideal candidate will have a...
-
Data Automation Expert
9 hours ago
Toronto, Ontario, Canada beBee Careers Full timeWe are seeking a skilled and motivated data generation automation ICC VIE to join the Integrated Control Center design team. In this role, you will be involved with the design teams managing the data preparation for the Oncorr project.">This project requires the deployment of new ways of working due to frequent data-only planned deliveries. As a result, the...
-
Test Automation Engineer
1 week ago
Toronto, Ontario, Canada Capco Full timeJob Overview:Capco is a leading provider of consulting and technology services to the financial services industry. We are seeking a highly skilled Test Automation Engineer to join our team. The successful candidate will have experience in designing and developing automated test cases, scripts, and traceability matrices based on business requirements...
-
Toronto, Ontario, Canada S.i. Systems Full timeInt. Data Engineer to support to build and automate databases for asset management data for a large banking client - 71915LOB: GAM Business Analytics & InsightsDuration:12 months(possibility of extension)Location:Downtown Toronto - Hybrid(2x per week in office, Tues/Thurs)The ideal candidate will have knowledge of current data technology and data engineering...