Data Automation Engineer

2 weeks ago


Toronto, Ontario, Canada MSI Corp Full time

We are seeking a highly skilled Data Automation Engineer to join our dynamic team. The successful candidate will be responsible for automating data workflows, optimizing data collection, processing, and integration processes, and ensuring the scalability and efficiency of our data pipelines. You will work closely with data engineers, analysts, and IT teams to design and implement solutions that automate the flow of data across various systems and platforms.

Key Responsibilities:
  • Design, build, and maintain automated data pipelines to ingest, process, and transform data from various sources to support business analytics, reporting, and decision-making.
  • Improve the efficiency and scalability of data workflows by automating repetitive tasks, such as data extraction, cleaning, and loading (ETL processes).
  • Work closely with data scientists, analysts, and IT teams to ensure that data flows smoothly across the organization and is processed correctly.
  • Develop automated validation checks and monitoring tools to ensure the quality and integrity of the data throughout the pipeline.
  • Build and Maintain Documentation: Document automation processes, pipelines, and systems to ensure transparency and ease of understanding for stakeholders and future team members.
  • Monitor and Troubleshoot Pipelines: Continuously monitor the performance of automated data pipelines and address any issues related to data quality, performance, or failures.
  • Automate Data Reporting: Create automated solutions for generating and delivering reports, dashboards, or notifications to relevant stakeholders.
  • Implement Best Practices: Follow and advocate for best practices in automation, data management, and security.
Skills & Qualifications:
  • Bachelor's Degree in Computer Science, Data Engineering, Information Technology, or related field (or equivalent experience).
  • 3+ years of experience in data automation, data engineering, or related roles.
  • Proficiency in Python or other scripting languages for data automation tasks.
  • Experience with ETL tools (e.g., Apache Airflow, Talend, Informatica, or custom Python-based pipelines).
  • Solid understanding of data storage technologies, such as relational databases (SQL), NoSQL, cloud storage, or data lakes.
  • Familiarity with cloud platforms (AWS, Google Cloud, Microsoft Azure) and related data services (e.g., S3, BigQuery, Redshift).
  • Experience with data processing frameworks like Apache Spark, Kafka, or Apache Beam is a plus.
  • Strong knowledge of data integration tools and techniques.
  • Ability to work with version control systems (e.g., Git) and CI/CD pipelines.
  • Understanding of data governance and best practices for data security and privacy.
  • Excellent problem-solving skills and the ability to troubleshoot complex data workflows.
  • Strong communication skills and the ability to collaborate effectively with cross-functional teams.
Preferred Qualifications:
  • Experience with data visualization and reporting tools (e.g., Power BI, Tableau).
  • Familiarity with containerization (Docker, Kubernetes) for deployment of data automation tools.
  • Knowledge of machine learning workflows and automating data processes for ML model training and deployment is a plus.
Seniority level

Mid-Senior level

Employment type

Contract

Job function

Engineering and Information Technology

Industries

Telecommunications

#J-18808-Ljbffr

  • Toronto, Ontario, Canada NTT DATA North America Full time

    About the Role:NNT DATA North America is seeking a highly skilled Salesforce QA Automation Engineer to join our team. As a key member of our Quality Assurance Test team, you will play a vital role in ensuring the digital technology and related services that we build for our clients are valuable, intuitive, and impactful.Key Responsibilities:1. Collaborate...


  • Toronto, Ontario, Canada RBC Full time

    About the RoleWe are looking for a Senior Automation Engineer with a strong background in Big Data technologies and automation tools to lead our QA efforts on Big Data projects. The ideal candidate will have a proven track record of leading QA teams and experience in designing and building robust automated testing frameworks.


  • Toronto, Ontario, Canada NTT DATA North America Full time

    Job OverviewAs a Salesforce QA Automation Engineer at NTT DATA North America, you will play a critical role in ensuring the digital technology and related services we build for our clients are valuable, intuitive, and impactful. Your primary responsibility will be to create and execute test plans, report test status, and participate in team meetings.Key...


  • Toronto, Ontario, Canada NTT DATA North America Full time

    Job DescriptionNTT DATA North America is seeking a skilled Salesforce QA Automation Engineer to join our team. This position involves creating and executing test plans, reporting test status, and participating in team meetings.About the RoleWe are looking for a motivated individual with 5+ years of experience in quality assurance processes, software...


  • Toronto, Ontario, Canada ATS Automation Full time

    About UsWe are ATS Automation, a global enterprise with a proud history. Our Life Sciences Systems division provides custom-designed automated solutions for medical device and pharmaceutical companies.Job SummaryWe are seeking an experienced Electrical Engineering Manager to lead our hardware engineering team. The successful candidate will have a strong...


  • Toronto, Ontario, Canada ATS Automation Full time

    Career OpportunityATS Automation is committed to innovation and continuous improvement. We offer a dynamic work environment where employees can grow and develop their skills.Job DescriptionThe Electrical Engineering Manager will be responsible for leading the hardware engineering team to design and implement control systems for industrial automation...


  • Toronto, Ontario, Canada NTT DATA North America Full time

    Req ID:312648NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Salesforce QA Automation Engineer - Remote Canada Position.Our Salesforce Quality Assurance Test teams are fundamental to...


  • Toronto, Ontario, Canada Cognizant Full time

    We're seeking a Senior SDET Quality Engineer with expertise in banking/finance automation to drive test efficiency. Key responsibilities include defining test strategies, creating test plans, executing test cases, and implementing automation solutions for our clients.About Cognizant's QA Practice:As the largest Quality Assurance Practice globally, we serve...


  • Toronto, Ontario, Canada MSI Corp Full time

    About the RoleMSI Corp is seeking a skilled Data Automation Engineer to join our team. As a key member of our dynamic group, you will be responsible for designing and implementing automated data pipelines to support business analytics, reporting, and decision-making.Key Responsibilities:We are looking for a highly skilled professional to design, build, and...

  • Data Engineer

    20 hours ago


    Toronto, Ontario, Canada beBee Careers Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will design and develop scalable cloud-based solutions using Azure Data Engineering, Databricks, and Medallion Data Lakehouse architectures.Your primary responsibility will be to build, automate, and optimize ETL/ELT pipelines...


  • Toronto, Ontario, Canada Cpus Engineering Staffing Solutions Inc. Full time

    About Cpus Engineering Staffing Solutions Inc.">We are a leading provider of staffing solutions in the field of engineering and technology. Our company is dedicated to connecting talented professionals with exciting opportunities that match their skills and interests.">Job Description">We are seeking a highly skilled DevOps Lead for Azure Environment to lead...


  • Toronto, Ontario, Canada NetBrain Technologies Inc. Full time

    About the RoleWe are seeking an experienced Automation Engineer with expertise in network technologies to join our team as a Senior Network Automation Services Engineer. In this role, you will work closely with customers to identify high-impact automation targets for their network operations through analysis of IT service management data.You will design and...

  • Automation Engineer

    2 hours ago


    Toronto, Ontario, Canada beBee Careers Full time

    About the RoleThis job is an exciting opportunity to work on ensuring the quality of our products. The Quality Engineering team works in partnership with other Technology Functions and the Business to ensure quality delivery of our products. The team works in an Agile environment and is located globally.The Main Responsibilities include:• Develop...

  • Data Engineer

    1 day ago


    Toronto, Ontario, Canada Toolbx US Inc. Full time

    Job Description Job Description Salary: 80,000K to 130,000KJob Title: Data Engineer (Remote)Company: TOOLBXLocation: Toronto, Canada (Remote)Type: Full TimeWebsite:About TOOLBX:TOOLBX is on a mission to improve construction material supply chain productivity by simplifying how builders order building supplies and how dealers sell their products through one...


  • Toronto, Ontario, Canada Global X Canada Full time

    Job Description:We are seeking an experienced Azure Cloud specialist to join our Digital Innovation & Data Analytics team. As an Azure Cloud engineer, you will be responsible for designing, building, and managing Azure Data Factory (ADF) pipelines for robust ETL processes.You will develop automation workflows using Azure Logic Apps and Power Automate,...

  • Data Engineer

    3 weeks ago


    Toronto, Ontario, Canada Teamrecruiter Inc Full time

    Our Banking client is looking for a Data Engineer (Capital Markets)Length: 12 months contract with the possibility of extension and conversion to full time employment Location: Toronto, ON (Hybrid) - 2 times per week in office (Tuesdays and Thursdays)Working Hours: 9 am to 5 pm Line of Business: Global Asset Management (GAM) - Business Analytics and...


  • Toronto, Ontario, Canada Avensia Technologies Full time

    Job Title: Senior Test Automation EngineerAbout the RoleWe are looking for an experienced Senior Test Automation Engineer to join our team at Avensia Technologies. The successful candidate will be responsible for developing and implementing testing protocols, reviewing data, and providing regular reports to senior management.The ideal candidate will have a...


  • Toronto, Ontario, Canada beBee Careers Full time

    We are seeking a skilled and motivated data generation automation ICC VIE to join the Integrated Control Center design team. In this role, you will be involved with the design teams managing the data preparation for the Oncorr project.">This project requires the deployment of new ways of working due to frequent data-only planned deliveries. As a result, the...


  • Toronto, Ontario, Canada Capco Full time

    Job Overview:Capco is a leading provider of consulting and technology services to the financial services industry. We are seeking a highly skilled Test Automation Engineer to join our team. The successful candidate will have experience in designing and developing automated test cases, scripts, and traceability matrices based on business requirements...


  • Toronto, Ontario, Canada S.i. Systems Full time

    Int. Data Engineer to support to build and automate databases for asset management data for a large banking client - 71915LOB: GAM Business Analytics & InsightsDuration:12 months(possibility of extension)Location:Downtown Toronto - Hybrid(2x per week in office, Tues/Thurs)The ideal candidate will have knowledge of current data technology and data engineering...