Data Engineer

1 month ago

Toronto Ontario, Ontario, Canada Agilus Work Solutions Full time

Data Engineer – Term Contract – 16 months


Agilus’ client is seeking an experienced Data Engineer to join our innovative team on a contract basis for 16 months. In this role you will design, optimize, and maintain scalable data infrastructure that supports various data initiatives, including AI and machine learning (ML) capabilities. You will be responsible for building and optimizing data pipelines that handle large-scale datasets for AI/ML models and analytics solutions.

This position reports to the Vice President of IT and offers a unique opportunity to work in a dynamic setting, leveraging cutting-edge technologies.

Key Responsibilities:


  1. Lead data and AI/ML initiatives by designing and optimizing data pipelines for large datasets, ensuring seamless integration, testing, and deployment.
  2. Oversee system and database integrations, facilitating scalable data flows and interoperability between platforms and applications.
  3. Develop and manage system and database integrations to ensure efficient, scalable data flows and interoperability between platforms and applications.
  4. Guide the development of reports and data analysis tools, providing timely, accurate insights for business decision-making.
  5. Collaborate with development teams on data modeling, database schema design, SQL query optimization, and the application of complex business rules.
  6. Automate ETL processes and database operations by writing stored procedures and scripts, enhancing the efficiency and reliability of data workflows.
  7. Perform proactive database maintenance and monitoring using modern tools (e.g., Datadog, New Relic) to ensure high availability, scalability, and performance.
  8. Identify, troubleshoot, and resolve database issues in production environments and during solution deployment, ensuring minimal disruption to business operations.
  9. Participate in the full application lifecycle, from technical design to cloud-based development, testing, and deployment, using platforms like AWS and Azure.
  10. Conduct peer code reviews and ensure adherence to best practices in software development and database management for quality and security.
  11. Stay up to date with the latest technologies in AI/ML, cloud computing, and data engineering to continuously enhance system capabilities and drive innovation.
  12. Prioritize and cope with competing and changing objectives in support of long-term goals while maintaining stakeholder expectations

Requirements:

  1. Education: Bachelor's or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
  2. Experience: at minimum 5 years of data engineering experience with a strong background in metadata management, AI/ML project support, and working with SQL and Python.


Technical Skills:

  • Data Analysis & Reporting: Proficiency in data analysis, reporting, and warehousing using tools like SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), and Tableau.
  • Database & Big Data Technologies: Extensive experience with database systems and big data
  • tools, including SQL, NoSQL, Hadoop, Spark, and Kafka, particularly in handling large, complex datasets.
  • Database Technologies: Strong command of relational database technologies, specifically MS SQL Server, MongoDB, AWS Redshift and PostgreSQL.
  • Performance Optimization: Proven expertise in performance tuning, query optimization, and experience with tools such as Performance Monitor, SQL Profiler, and other monitoring and troubleshooting tools.


Programming Languages & Development Tools:

  • Proficiency in Python and working knowledge of other development languages and frameworks.
  • Experience with modern IDEs like Visual Studio Code and SCM tools such as Jira, Git, and Bitbucket.
  • ·Cloud & Agile Methodologies: Working knowledge of cloud platforms, particularly Microsoft Azure and Amazon Web Services (AWS).
  • Understanding of Agile, Scrum, and other iterative development methodologies.


Bonus Skills:

Experience with MuleSoft, Salesforce, and API integrations is a plus.

Please note the following 2 pre-conditions to be considered for this opportunity:

You must have Canadian citizenship, be a permanent resident or have an active work permit with a

term that covers the entire length of the contract.

You must reside in the GTA to be able to comply with our hybrid work schedule, which requires

regular in-person days in the office.

  • Data Engineer

    1 month ago

    Toronto, Ontario, Ontario, Canada Mewar Info Tech Limited Full time

    Data EngineerAbout the Role:As a Data Engineer, you will play a crucial role in designing, building, and maintaining our data infrastructure. You will work closely with data scientists, analysts, and engineers to extract, transform, and load data from various sources into our data warehouse and data lake. Your expertise in data engineering will help us...

  • Data Engineer

    2 months ago

    Toronto, Ontario, Ontario, Canada Banting AI Full time

    About Banting AIBanting AI is harnessing the power of advanced AI to reshape the future of healthcare. We believe that by optimizing clinical research and unlocking the full potential of healthcare data, we can accelerate the path to life-saving treatments. Our mission is ambitious: to build technology that empowers and accelerates clinical research and...

  • Data Engineer

    1 month ago

    Toronto, Ontario, Ontario, Canada Conspicuous Full time

    Data Engineer – Microsoft Fabric & Azure Data FactoryRemote - Canada onlyUp to CA$80/hr C2CContractAbout the Role:Join a cutting-edge finance organization driving innovation in digital banking. We are seeking a Data Engineer with expertise in Microsoft Fabric, Azure Data Factory, D365 CE, and digital banking systems. In this role, you will design and...

  • Data Engineer

    4 months ago

    Toronto, Ontario, Ontario, Canada Tactable Full time

    A Data Engineer at Tactable is a professional with a deep understanding of python, data pipelines, and various types of data storage. In this role, you’ll take the lead in building data pipelines used to ingest the information that fuels models and trading systems.Responsibilities:Work with proprietary tools and technologies including time series...

  • Data Engineer

    1 month ago

    Toronto, Ontario, Ontario, Canada MSR Technology Group Full time

    Position: AWS Data EngineerLocation: Toronto, ON (Hybrid)Mandatory Skills: AWS, Glue, SQL, Redshift, LambdaJob Description:8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work...

  • Data Engineer

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Compunnel Inc. Full time

    Hi,Good MorningHope you are doing well.Please let me know if you are interested in this position.Title: Sr. Data Engineer LeadLocation: Toronto, Ontario – Day 1 Onsite Job Description :8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any...

  • Data Engineer

    4 weeks ago

    Toronto, Ontario, Ontario, Canada WizeWerks Full time

    Data Engineer - Client-Facing Role WizeWerks | Full-time | On-site at Client Location About WizeWerks WizeWerks is a boutique consultancy in Toronto, ON, specializing in AI-driven technology solutions. We focus on integrating generative AI and LLM across internal operations and client services, using in-house AI tools to streamline delivery and maintain...

  • Senior Data Engineer

    1 month ago

    Toronto, Ontario, Ontario, Canada Finance Professionals Inc. Full time

    Senior Data Engineer Job Description Location: Hybrid, 3 days onsite – Downtown, Toronto Duration: 1 year (Extension - Yes depending on performance (looking for a long-term person)What you will do:• Work with business stakeholders and cross-functional teams to understand data requirements and deliver scalable data solutions. • Design, develop, and...

  • AWS Data Engineer

    1 month ago

    Toronto, Ontario, Ontario, Canada Tata Consultancy Services Full time

    "Skills and Responsibilities:8+ Years experience is must in AWS data Engineer• Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).• Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.Key skills: •AWS Glue,...

  • Senior Data Engineer

    1 month ago

    Toronto, Ontario, Ontario, Canada Quantum World Technologies Inc. Full time

    Data Engineer Hybrid Onsite from Toronto ON CanadaJob Description :Minimum 8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Devops, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various...

  • Lead Data Engineer

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Cygnus Professionals Inc. Full time

    Title: Sr. Data Engineer LeadLocation: Toronto, OntarioJob Description :8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various...

  • Data Engineer

    2 days ago

    Toronto, Ontario, C6A, Ontario, Canada Patch Tech Staffing Full time

    We are seeking a highly motivated and skilled Data Engineer to join our growing data team. In this role, you will play a crucial part in designing, building, and maintaining our data infrastructure and pipelines. You will be responsible for ingesting, transforming, and loading data from various sources into our data warehouse, ensuring its quality,...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Compunnel Inc. Full time

    Title: Sr. Data Engineer LeadLocation: Toronto, Ontario – Day 1 Onsite Job Description:8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming...

  • AWS Data Engineer

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Compunnel Inc. Full time

    Role: AWS Data EngineerLocation: Toronto, ON, CAJob type: Contract Duration: 12+ Months Required skills: AWS, Glue, SQL, Redshift, Lambda Job Description :8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is...

  • Data Engineer

    2 weeks ago

    Toronto, Ontario, C6A, Ontario, Canada Quarry Consulting Full time

    Title: Data EngineerLocation: Old Toronto, ON - 2/3 times a week on-siteDuration: Permanent role FTKey Responsibilities:Design, develop, and maintain data pipelines for handling large volumes of data streams using Apache Kafka.Implement real-time data processing solutions using Apache Flink or Apache Spark.Build and maintain RESTful APIs using Spring Boot to...

  • Data Engineer

    11 hours ago

    Toronto, Ontario, C6A, Ontario, Canada Insight Global Full time

    6 month contract + possible extensions Hybrid 2x per week in Toronto Pay: $50-60/hr incorporated Must haves:3-5 years of experience as a Data Engineer.Strong experience with ETL development, including creating new ETLs to move information.3-5 years of Python experience Strong experience with large data sets Proven expertise in building out data pipelines...

  • Data Engineer

    4 days ago

    Toronto, Ontario, C6A, Ontario, Canada Themesoft Inc. Full time

    Position: Data EngineerLocation: Toronto -HybridRequired Skills: 1. Azure Data Engineer 2. Strong In Database skills 3. DatabricksJob Summary: The ideal candidate will have extensive knowledge and hands-on experience with Azure Synapse, Azure Data Factory ETL, Azure Data Lake, Azure Data Lake Store, and Azure Databricks.Responsibilities:Lead the design and...

  • Data Engineer/Lead

    4 months ago

    Toronto, Ontario, Ontario, Canada Kumaran Systems Full time

    Responsibilities: Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lakeDesign and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure DatabricksDeveloping scalable and re-usable...

  • Azure Data Engineer

    2 months ago

    Toronto, Ontario, Ontario, Canada Procom Full time

    The role: In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake the responsibility of executing and managing Azure Data Factory Pipelines. This includes the design and implementation of the Data Lake, as well as the optimization of data refresh performance.The role encompasses ownership (both execution and management)...

  • Data Engineer

    4 days ago

    Toronto, Ontario, C6A, Ontario, Canada Strategic Solutions Technology Staffing Inc. Full time

    Our client is a multi-strategy alternative asset manager with global expertise in private equity, venture capital, credit, and more. They are committed to delivering innovative solutions that drive value for investors and stakeholders. As part of their team, you’ll work in a dynamic and collaborative environment that emphasizes data-driven decision-making...