Apache Airflow Architect with Astronomer

1 week ago

Mississauga, Ontario, Canada Itech Enterprises Full time $65,000 - $75,000 per year

The Solutions Architect specializing in Cloud Orchestration, will work with a small group of technologists and become a trusted advisor delivering technical solutions leveraging Apache Airflow hosted on the Astronomer platform. In this role, he will engineer a wide range of use cases where, Apache Airflow sits at the center of the solution, with the goal of rapidly developing solutions for the use cases.

  • Help guide a small group of technologists in their Apache Airflow journeys, including identifying new use cases and onboarding new domain teams.
  • Review, optimize, and tune data ingestion and extraction pipelines orchestrated by Airflow.
  • Development of frameworks to manage and engineer a large number of pipelines for the entire domain.
  • Build architecture, data flow, and operational diagrams and documents, with detailed physical and logical layers.
  • Provide reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with 3rd party solutions.
  • Keep up with the latest Astro and Airflow features, in order to better advise the technologies on impactful improvements they can make.
  • Collaborate to build reusable assets, automation tools, and documented best practices.
  • Interact with Domain and Engineering teams to channel product feedback and requirements discussions.
  • Work with technology team members to ensure that are realizing value in their Airflow and Astronomer journeys

Skills Required:

  • Experience with Apache Airflow in production environments.
  • Experience in designing and implementing ETL, Data Warehousing, and ML/AI use cases.
  • Proficiency in Python.
  • Knowledge of Azure cloud-native data architecture.
  • Demonstrated technical leadership on team projects.
  • Strong oral and written communication skills.
  • Willingness to learn new technologies and build reference implementations.
  • Experience in migrating workflows from legacy schedulers (Tidal) to Apache Airflow.
  • Experience in integrating with Azure Data Factory pipelines.
  • Snowflake and Databricks experience.
  • Experience working with containers.
  • SQL experience.
  • Kubernetes experience, either on-premise or in the cloud.
  • Enterprise data experience in regulated environments.

Job Type: Full-time

Pay: $65.00-$75.00 per hour

Expected hours: 40 per week

Work Location: In person

  • Mid-level Data Engineer + MDM

    2 weeks ago

    Mississauga, Ontario, Canada Vaiticka Solution Full time $120,000 - $180,000 per year

    Job Title: Mid-level Data Engineer + MDMJob Location: Mississauga, ONJob Type –ContractJob Description:Key Responsibilities:Lead and contribute to one or more end-to-end Master Data Management (MDM) projects, ensuring data quality, consistency, and integrity across enterprise systems.Design, develop, and maintain data pipelines, architectures, and...

  • Senior Data Engineer

    1 week ago

    Mississauga, Ontario, Canada Apptad Full time $120,000 - $180,000 per year

    Job Title: Senior Data Engineer -MDMJob Location: Mississauga, ON (3 days onsite in a week)Duration: Long TermJob Description:We are seeking a seasoned Senior Data Engineer with extensive experience in MDM implementations, preferably within the financial services or investment banking sector. The ideal candidate will have a proven track record of...

  • Senior Big Data Engineer

    3 days ago

    Mississauga, Ontario, Canada Citi Full time US$94,300 - US$141,500

    The Big Data Engineer is a senior level position responsible for establishing andimplementing new or revised application systems and programs in coordination with theTechnology team. The overall objective of this role is to lead applications systems analysisand programming activities.Responsibilities:Partner with multiple management teams to ensure...

  • Senior Big Data Engineer

    3 days ago

    Mississauga, Ontario, Canada Citi Full time US$94,300 - US$141,500

    The Big Data Engineer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.Responsibilities:Partner with multiple management teams to ensure...

  • O9 Solution Architect

    3 days ago

    Mississauga, Ontario, Canada Cognizant Full time US$100,000 - US$200,000 per year

    About The RoleAs a Senior Solution Architect, you will lead the design and delivery of high-performance supply chain solutions on the o9 platform, with a focus on solution architecture. The role requires deep SCM expertise and a strong track record in digital transformation.In This Role, You WillLead the design and delivery of scalable, high-performance SCM...

  • ML Engineer Nearshore

    1 week ago

    Mississauga, Ontario, Canada BayOne Solutions Full time $120,000 - $140,000 per year

    Key Responsibilities:Design, develop, and maintain ETL/ELT pipelines for structured and unstructured data.Implement scalable data architectures using cloud platforms (AWS, GCP, Azure).Develop and optimize machine learning pipelines for training, validation, and deployment .Work closely with data scientists to productionize ML models using MLflow, TensorFlow,...

  • Senior Data Analytics Developer

    7 days ago

    Mississauga, Ontario, Canada Citi Full time $80,000 - $141,500 per year

    We are seeking a talented and experienced Data Analytics Developer to join our team. You will play a key role in designing, developing, and maintaining our next-generation data analytics platform. This involves building scalable and efficient data pipelines, optimizing query performance, and implementing robust solutions to enable real-time and historical...

  • Senior Data Engineer

    1 week ago

    Mississauga, Ontario, Canada fc71e8c5-deda-48e9-b38c-23c0611c543b Full time $70,000 - $150,000 per year

    Key Responsibilities:Design, build, and maintain scalable and reliable ETL/ELT pipelines for structured and unstructured data.Architect and implement data lakes, data warehouses, and analytical data models using modern cloud technologies.Build and optimize distributed data processing systems using tools like Apache Spark, Databricks, Hadoop, Flink, Beam, or...

  • Security Tester

    3 days ago

    Mississauga, Ontario, Canada Tek Tron IT Full time US$70,000 - US$110,000 per year

    Key Responsibilities:Design and implement end-to-end data architecture, including data models, data pipelines, integration layers, and storage solutions.Develop scalable, secure, and high-performing data platforms across cloud environments (Azure, AWS, or GCP).Define enterprise data standards, governance frameworks, metadata models, and data lifecycle...

  • Software Developer II

    1 week ago

    Mississauga, Ontario, Canada Walmart Connect Canada Full time $92,320 - $105,200 per year

    Position Summary...The Senior Software Developer will play a key role in driving technical excellence across development teams. This position involves active participation in design and architecture discussions, mentoring team members, and ensuring adherence to coding standards and best practices. The role also requires hands-on troubleshooting, leadership...