Data Engineer

3 weeks ago

New Canada NS Open Systems Technologies Full time

We provide: • A robust career development path offering numerous opportunities for growth, learning and advancement. • A supportive, learning-oriented environment in collaboration with development within fast-feedback agile delivery squads • Collaborative work within cross-functional squads, following agile practices and utilizing both cloud and on-premises technology to deliver innovative solutions. • Encouragement for every developer to contribute their unique perspective - your ideas will be valued, and you'll receive full support in their implementation • Participation in an international environment with various multidisciplinary squads, working alongside customers, product experts, and SREs. • A dynamic environment where cutting-edge technology propels us. • State-of-the-art offices located in the City Centre designed to enhance collaboration. Role Responsibilities • Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks • Developing and deploying ETL jobs that extract data from various sources, transforming it to meet business needs. • Taking ownership of the end-to-end engineering lifecycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency. • Creating and manage data pipelines, ensuring proper error handling, monitoring and performance optimizations • Working in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives. • Conducting code reviews, providing constructive feedback, and enforcing coding standards to maintain a high quality. • Developing and maintaining tooling and automation scripts to streamline repetitive tasks. • Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes • Utilizing REST APIs and other integration techniques to connect various data sources • Maintaining documentation, including data flow diagrams, technical specifications, and processes. You have: • Proficiency in Python programming, including experience in writing efficient and maintainable code. • Hands-on experience with cloud services, especially DataBricks, for building and managing scalable data pipelines • Proficiency in working with Snowflake or similar cloud-based data warehousing solutions • Solid understanding of ETL principles, data modelling, data warehousing concepts, and data integration best practices • Familiarity with agile methodologies and the ability to work collaboratively in a fast-paced, dynamic environment. • Experience with code versioning tools (e.g., Git) • Meticulous attention to detail and a passion for problem solving • Knowledge of Linux operating systems-Familiarity with REST APIs and integration techniques You might also have: • Familiarity with data visualization tools and libraries (e.g., Power BI) • Background in database administration or performance tuning • Familiarity with data orchestration tools, such as Apache Airflow • Previous exposure to big data technologies (e.g., Hadoop, Spark) for large data processing

  • (Cloud) Data Engineer

    3 weeks ago

    New Canada, NS Realist AI Full time

    Role: Cloud Data Engineer SUBCONTRACTOR Realist AI, an industry leader in data and cloud solutions, is seeking data engineers to join our growing network of subcontractors. We are looking for professionals with a passion for building scalable, reliable data pipelines to support cutting-edge Cloud applications and to support the many data offerings Realist AI...

  • Data Engineer

    3 weeks ago

    New Canada, NS Mastech Digital Full time

    Role Details: This job is for someone who makes sure data is flowing smoothly, accurately, and without problems across the company. You will: Watch and monitor data systems to catch issues early Investigate and fix data problems when something goes wrong Work closely with the Lead Engineer and partners to solve technical challenges Make sure the company...

  • Data Engineer

    18 hours ago

    New Canada, NS Mastech Digital Full time

    Role Details: This job is for someone who makes sure data is flowing smoothly, accurately, and without problems across the company. You will: Watch and monitor data systems to catch issues early Investigate and fix data problems when something goes wrong Work closely with the Lead Engineer and partners to solve technical challenges Make sure the company...

  • Data Engineer

    3 weeks ago

    New Canada, NS TechDoQuest Full time

    Assessment & Responsibilities: Experience in Data Connection, extraction from different systems including both cloud based and On Premise systems (e.g. Azure, Oracle, SAP, BMC, SNOW, Salesforce etc.) and transformation & loading into the process mining tool. Support validation of data (counts, values between source systems and process mining tool)....

  • Test Data Engineer

    3 weeks ago

    New Canada, NS Avanciers Inc. Full time

    Avanciers is seeking a highly skilled Test Data Engineer to join our team for an exciting Fulltime role with one of our esteemed Fortune 500 clients, based in Canada. This is a REMOTE role. Position: Test Data Engineer Location: [CANADA (REMOTE) Job Description: The Test Data Engineer is a critical role responsible for establishing, implementing, and...

  • Senior Data Engineer

    3 weeks ago

    New Canada, NS Quarry Consulting Full time

    Role: Senior Data Engineer Location: Remote Contract: 1 year Requirements: Programming experience in Spark using modern languages such as Python, Scala Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes Experience leading Data Engineering principles...

  • Data Engineer

    3 weeks ago

    New Canada, NS Avanciers Inc. Full time

    Avanciers is seeking a highly skilled Data Engineer - TDM, IDMC to join our team for an exciting Fulltime role with one of our esteemed Fortune 500 clients, based in Canada. This is a REMOTE role. Position: Data Engineer - TDM, IDMC Location: [CANADA (REMOTE) Job Description: The Test Data Engineer is a critical role responsible for establishing,...

  • Data Quality Engineer

    3 weeks ago

    New Canada, NS Open Systems Technologies Full time

    Job Responsibilities • Collaborate with cross divisional project managers, technology product owners, and firm data office engineering teams to ensure alignment on goals and deliverables for the global regulatory program delivering data quality reporting on critical reporting • Conducts a communication style that effectively "bridges the gaps" between...

  • Azure Data Engineer

    2 weeks ago

    New Canada, NS TALENDICA Full time

    Position: Senior/Lead Data Engineer Location: New Brunswick, CA (Remote) Duration: 6+ month Responsibilities Design, develop, and maintain data pipelines and orchestration workflows using Azure Synapse and Microsoft Fabric. Build, enhance, and support ETL processes for both on-premise data stores and enterprise data warehouses. Integrate, transform, and...

  • Microsoft Azure Data Engineer

    2 weeks ago

    New Canada, NS TALENDICA Full time

    Position: Senior/Lead Data Engineer Location: New Brunswick, CA (Remote) Duration: 6+ month Responsibilities Design, develop, and maintain data pipelines and orchestration workflows using Azure Synapse and Microsoft Fabric. Build, enhance, and support ETL processes for both on-premise data stores and enterprise data warehouses. Integrate,...