Data Engineer

1 week ago

Halifax NS, Canada ThoughtsWin Full time

Job Description Looking for Senior Data Engineers who are experienced, self-driven, analytical, and strategic. In this role, you will work with clients across large and complex data lake/warehouse environments. You are passionate about working with disparate datasets in order to bring data together to answer business questions. You should have deep expertise in the creation and management of datasets and the proven ability to translate the data into meaningful insights through collaboration with product managers, data engineers, business intelligence developers, operations managers and client leaders. In this role, your skills and expertise will be integral in strategic decision-making, answering complex questions by taking ownership of the end-to-end development of data engineering solutions. Responsibilities Interface with project managers, business customers, data architects and data modelers to understand requirements and implement solutions. Design, develop, and operate highly-scalable, high-performance, low-cost, and accurate data pipelines in distributed data processing platforms providing ad hoc access to large datasets and computing power. Explore and learn the latest big data technologies. Evaluate and make decisions around the use of new or existing software products to design data architectures. Recognize and adopt best practices in data processing, reporting, and analysis: data integrity, test design, analysis, validation, and documentation. Qualifications Bachelor's degree in Computer Science or related technical field, or equivalent work experience. 5+ years of work experience with ETL, Data Modeling, and Data Architecture. 5+ years of experience with SQL and large data sets, data modeling, ETL development, and data warehousing, or similar skills. 2+ years experience with the AWS or MS Azure technology stacks. AWS should include Redshift, RDS, S3, EMR or similar solutions built around Hive/Spark etc. MS Azure should include ADF, Azure BLOB storage, Azure Synapse etc. Excellent in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies. Experience operating very large data warehouses or data lakes. Experience with building data pipelines and applications to stream and process datasets at low latencies. Demonstrate efficiency in handling data – tracking data lineage, ensuring data quality, and improving discoverability of data. Knowledge of distributed systems and data architecture – design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures. Experience with full software development life cycle, including coding standards, code reviews, source control management, build processes, and testing. Industry Information Technology & Services

  • Data Analyst

    6 days ago

    Halifax, Canada NTT DATA Full time

    We are currently seeking a **Data Analyst **to join our team **Remote** based anywhere in **Canada.** - Commissioning and decommissioning of data sets. - Processing confidential data and information according to guidelines. - Help to develop reports and analysis. - Managing and designing the reporting environment, including data sources, security, and...

  • Software Engineer in Test

    2 weeks ago

    Halifax, Nova Scotia, Canada NTT DATA Full time $80,000 - $120,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Software Engineer in Test (Onsite) to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA). Job Responsibilities Include: ...

  • Mainframe Engineer/Developer

    1 week ago

    Halifax, Canada NTT DATA Full time

    Job Description Req ID: 318421 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Mainframe Engineer/Developer to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA). This...

  • SDET Software Engineer in Test

    2 weeks ago

    Halifax, Nova Scotia, Canada NTT DATA Full time $80,000 - $120,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a SDET Software Engineer in Test - On-site to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA). Responsibilities: ...

  • AI Engineer

    4 weeks ago

    Halifax, Canada NTT DATA North America Full time

    Join to apply for the AI Engineer role at NTT DATA North America. Location: Canada – Remote. Pay Range: $55.00/hr - $65.00/hr. This range is provided by NTT DATA North America. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Overview We are seeking a highly motivated and skilled AI Engineer to join...

  • AI Engineer

    3 weeks ago

    Halifax, Canada NTT DATA North America Full time

    Join to apply for the AI Engineer role at NTT DATA North America . Location: Canada – Remote. Pay Range: $55.00/hr - $65.00/hr. This range is provided by NTT DATA North America. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Overview We are seeking a highly motivated and skilled AI Engineer to join...

  • Mainframe Engineer

    4 weeks ago

    Halifax, Canada NTT DATA Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mainframe Engineer / Developer (Onsite Full-time) to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA). We...

  • Data Engineer

    2 weeks ago

    New Canada, NS TEEMA Full time

    Data Engineer Must Haves: Minimum of proven experience working as a Data Engineer or similar role. Experience using Informatica software (i.e., Power Centre, Integration Services, Workflow Manager, IDMC and TDM) in an integrated support environment. Expert knowledge of Oracle and SQL Server Database Management Systems and tools. ETL and data pipeline...

  • Software Engineer in Test

    4 weeks ago

    Halifax, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Software Engineer in Test...

  • Software Engineer in Test

    4 weeks ago

    Halifax, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content LinkSelect how often (in days) to receive an alert: Create AlertNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer in Test (Onsite)...