Data Engineer

3 weeks ago

Canada Summer Full time

Title: Data Engineer

Location: Remote Canada

About this Role:

As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the success of our data-driven initiatives, supporting data scientists, software developers, and business stakeholders. If you are passionate about working with large datasets, implementing efficient data solutions, and staying at the forefront of data engineering technologies, we invite you to join our dynamic team.

Responsibilities:

Data Pipeline Development:

  • Design, build, and maintain scalable and efficient data pipelines for the acquisition, transformation, and loading of large volumes of data from various sources.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure that data pipelines meet business needs.

Data Modeling:

  • Develop and implement data models, schema designs, and database structures to support the organization's data needs.
  • Optimize database performance and ensure data integrity and consistency.

ETL Processes:

  • Create Extract, Transform, Load (ETL) processes to clean, transform, and aggregate raw data into a format suitable for analysis.
  • Implement and maintain data integration solutions between different systems and platforms.

Data Warehousing:

  • Design and maintain data warehouse systems to store and organize large volumes of structured and unstructured data.
  • Ensure the scalability and efficiency of data warehousing solutions.

Data Quality and Governance:

  • Implement data quality checks, validation rules, and governance processes to ensure the accuracy and reliability of data.
  • Work on data profiling and data cleansing activities.

Big Data Technologies:

  • Utilize big data technologies such as Hadoop, Spark, and related frameworks for processing and analyzing large datasets.
  • Stay updated with emerging technologies in the big data ecosystem.

Collaboration:

  • Collaborate with cross-functional teams, including data scientists, analysts, software developers, and business stakeholders, to understand data needs and deliver effective solutions.

Monitoring and Optimization:

  • Implement monitoring and logging mechanisms to track the performance and health of data pipelines, ML models and business dashboards.
  • Optimize and tune existing data infrastructure for improved efficiency and performance.

Security and Compliance:

  • Implement security measures to protect sensitive data and ensure compliance with data privacy regulations.
  • Collaborate with the security team to establish and enforce data security policies.

Documentation:

  • Document data engineering processes, data flows, and system architecture to ensure knowledge transfer and maintainability.
  • Provide training and support to other team members on data engineering best practices.

Continuous Learning:

  • Stay informed about industry trends, best practices, and emerging technologies in data engineering.
  • Participate in training and development activities to enhance skills and knowledge.

Responsibilities (cont.)

  • Design, automate, optimize and scale end-to-end workflows for the acquisition and transformation of data.
  • Implement and optimize ETL processes to ensure the accuracy and reliability of our data.
  • Build and maintain data models and structures to support analytics and reporting.
  • Help productionize ML models and data artifacts.
  • Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
  • Utilize big data technologies for processing and analyzing large datasets.
  • Monitor and optimize data infrastructure for performance and efficiency.
  • Implement security measures and ensure compliance with data privacy regulations.
  • Document data engineering processes, flows, and system architecture.
  • Stay informed about industry trends and emerging technologies in data engineering.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer or in a similar role.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Strong knowledge of SQL and experience with relational and NoSQL databases.
  • Experience with big data processing frameworks (e.g., Hadoop, Spark).
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
  • Expertise in ETL tools and processes.
  • Understanding of data modeling concepts and techniques.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration abilities.
  • Experience with version control systems (e.g., Git) and CI/CD processes is a plus.
  • Familiarity with containerization tools (e.g., Docker, Kubernetes)

You'll love working at Summer because of our...

  • Amazing purpose-driven team and culture
  • Competitive salary and stock options.
  • Unlimited, flexible PTO for exempt employees
  • Excellent medical, dental and vision coverage
  • Paid maternity and paternity leave

  • Data Engineering Specialist

    7 days ago

    Canada Data Elephant Full time

    About UsData Elephant is a boutique data and analytics consulting firm based in Vancouver, BC. We help Canadian organizations develop data strategies, modernize their data platforms, and unlock the power of data, analytics, and AI.We're looking for a Cloud Data Solutions Architect to join our growing team. In this role, you'll contribute to the design,...

  • Databricks Data Engineer

    1 week ago

    Canada Data Elephant Full time

    About UsWe're a boutique data and analytics consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms and unlock the power of data, analytics, ML and GenAI. As a certified partner with leading cloud platforms, including AWS, Azure and Databricks, we deliver strategic solutions that create...

  • Databricks Data Engineer

    7 days ago

    Canada Data Elephant Full time

    About Us We're a boutique data and analytics consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms and unlock the power of data, analytics, ML and GenAI. As a certified partner with leading cloud platforms, including AWS, Azure and Databricks, we deliver strategic solutions that create...

  • Data Engineering Lead for Cloud Data Platforms

    1 week ago

    Canada Data Elephant Full time

    About Data ElephantWe're a boutique data and analytics consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms, and unlock the power of data, analytics, ML, and GenAI.Our MissionWe deliver strategic solutions that create real business impact. Our team thrives on solving complex...

  • Big Data Pipeline Developer

    7 days ago

    Canada Data Elephant Full time

    About the Role:We're looking for a Data Engineer to join our growing team. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying modern data solutions using Azure, AWS, and Databricks.Your primary focus will be on building scalable and efficient data pipelines that meet the needs of our clients. You...

  • Cloud Data Solutions Architect

    7 days ago

    Canada Data Elephant Full time

    Job Description:We are seeking a Big Data Pipeline Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying big data pipelines using Azure Databricks, Delta Lake, and AWS Glue.Your primary focus will be on building scalable and efficient data pipelines that meet the needs of...

  • Data Engineer

    3 days ago

    Canada KData AI Full time

    Company Description KData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. We are looking for an experienced Data Architect with a minimum of 5 years in designing...

  • Data Engineer

    6 days ago

    Canada KData AI Full time

    Company Description KData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. We are looking for an experienced Data Architect with a minimum of 5 years in designing...

  • Data Engineer

    4 weeks ago

    Canada KData AI Full time

    Company DescriptionKData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. Follow us on Twitter: @KDataAI.Role DescriptionThis is a full time role for a Data Engineer....

  • Data Engineer

    11 hours ago

    Canada Aadhya Tech Inc Full time

    Company Description Aadhya Tech Inc specializes in delivering IT consulting and recruitment services to help businesses thrive in the digital world. With a focus on quality, agility, and innovation, we solve complex tech challenges and build teams for long-term success. Our services include IT consulting, technical and non-technical recruitment, staffing,...

  • Data Engineer

    4 hours ago

    Canada Aadhya Tech Inc Full time

    Company Description Aadhya Tech Inc specializes in delivering IT consulting and recruitment services to help businesses thrive in the digital world. With a focus on quality, agility, and innovation, we solve complex tech challenges and build teams for long-term success. Our services include IT consulting, technical and non-technical recruitment, staffing,...

  • Data Engineer

    7 days ago

    Canada NXT Move IT Solutions Inc Full time

    Company DescriptionNXT Move IT Solutions Inc. is a Toronto-based company providing cutting-edge IT services, expert consulting, and technology recruitment solutions across North America. We specialize in application development, cloud architecture, DevOps engineering, cybersecurity, data platforms, and enterprise systems. Serving clients locally and...

  • Data Engineer

    1 week ago

    Canada United Software Group Inc Full time

    Job Title: Data EngineerRemote work12 Months ContractPosition overview : Help us create our Financial Data Warehouse using dbt, Dagster, Snowflake and Power BIResponsibilities :Build our data pipelines for our Financial Data WarehouseBuild power bi reports and dashboards associated to this processContribute to our strategy for new data pipelines and data...

  • Data Engineer

    4 days ago

    Canada United Software Group Inc Full time

    Job Title: Data Engineer Remote work 12 Months Contract Position overview : Help us create our Financial Data Warehouse using dbt, Dagster, Snowflake and Power BI Responsibilities : Build our data pipelines for our Financial Data Warehouse Build power bi reports and dashboards associated to this process Contribute to our strategy for new data...

  • Data Engineer

    3 weeks ago

    Canada hireVouch Full time

    Our client is a leading data and cloud services provider that works with enterprise companies to build systems and infrastructures for them. As a Data Engineer, you'd be responsible for designing, building, and optimizing data pipelines, ensuring seamless data flow and analytics capabilities. This is a 6-month contract, with a possibility of extension. ...

  • Data Engineer

    2 weeks ago

    Canada IT Chapter Full time

    The Data Engineer will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies. The Senior Data Engineer Service Provider must have experience in leading, designing, implementing, and collaborating with stakeholders to achieve the...

  • Data Engineer

    3 days ago

    Canada Hire DigITalent Inc. Full time

    We are seeking an experienced and detail-oriented Data Engineer to join one of our clients teams. In this role, you will be responsible for architecting and maintaining reliable, scalable data solutions that enable seamless data flow across various platforms. Your expertise in Boomi iPaaS will be central to building and optimizing integrations between...

  • Data Engineer

    9 hours ago

    Canada Hire DigITalent Inc. Full time

    We are seeking an experienced and detail-oriented Data Engineer to join one of our clients teams. In this role, you will be responsible for architecting and maintaining reliable, scalable data solutions that enable seamless data flow across various platforms. Your expertise in Boomi iPaaS will be central to building and optimizing integrations between...

  • Data Engineer

    3 weeks ago

    Canada hireVouch Full time

    Our client is a leading data and cloud services provider that works with enterprise companies to build systems and infrastructures for them.As a Data Engineer, you'd be responsible for designing, building, and optimizing data pipelines, ensuring seamless data flow and analytics capabilities.This is a 6-month contract, with a possibility of...

  • Data Engineer

    1 week ago

    Canada Quantum World Technologies Inc. Full time

    8 year's experience in IT with a focus on data engineering and architecture. In addition to deep knowledge of PostgreSQL, the candidate should have expertise of Snowflake or ElasticSearch.In-depth knowledge of architecture, functions, and data warehousing concepts. ETL & Data Modeling: Advanced skills in ETL processes, data modeling, and data warehousing....