Data Engineer

2 weeks ago

Toronto, Canada I-cube Software Llc Full time

Hybrid Hadoop Engineer Hybrid Hadoop Engineer and Hadoop Infrastructure Administrator to build and maintain a scalable and resilient Big Data framework to support Data Scientists. As an administrator, your responsibility will be to deploy and maintain Hadoop clusters, add and remove nodes using cluster management and monitoring tools like Cloudera Manager, and support performance and scalability requirements, in support of our Data scientist's needs. Some Relational Database administrator experience will also be desirable to support the general administration of Relational Databases. Design, build, and maintain Big Data workflows / pipelines to process a continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines. Demonstrated work experience in the following with Big Data and distributed programming models and technologies Knowledge of database structures, theories, principles, and practices (both SQL and NoSQL). Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL / data pipelines Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive Understanding of Map Reduce and other Data Query and Processing and aggregation models Understanding of challenges of transforming data across distributed clustered environment Experience with techniques for consuming, holding, and aging out continuous data streams Ability to provide quick ingestion tools and corresponding access APIs for continuously changing data schema, working closely with Data Engineers around specific transformation and access needs Preferred Experience as a Database administrator (DBA) will be responsible for keeping critical tools database up and running Building and managing high-availability environments for databases and HDFS systems Familiarity with transaction recovery techniques and DB Backup Skills and Attributes Ability to have effective working relationships with all functional units of the organization Excellent written, verbal, and presentation skills Excellent interpersonal skills Ability to work as part of a cross-cultural team Self-starter and Self-motivated Ability to work without lots of supervision Works under pressure and is able to manage competing priorities. #J-18808-Ljbffr

  • Manager, Data Centre Facilities Engineering

    2 weeks ago

    Toronto, ON MW G, Canada NTT DATA Full time $120,000 - $180,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager, Data...

  • Data Architect

    2 weeks ago

    Toronto, Canada JamLabs Data Science Full time

    Overview We are seeking an experienced Data Architect to lead the design and implementation of a scalable, cloud-based data architecture supporting the analytics and reporting needs of a private equity fund management firm. This role focuses on building a robust, high-performance data platform leveraging Azure Synapse, Snowflake, dbt, and Dagster. Open to...

  • Data Architect

    2 weeks ago

    Toronto, Canada JamLabs Data Science Full time

    OverviewWe are seeking an experienced Data Architect to lead the design and implementation of a scalable, cloud-based data architecture supporting the analytics and reporting needs of a private equity fund management firm. This role focuses on building a robust, high-performance data platform leveraging Azure Synapse, Snowflake, dbt, and Dagster. Open to...

  • Data Architect

    3 weeks ago

    Toronto, Canada JamLabs Data Science Full time

    OverviewWe are seeking an experienced Data Architect to lead the design and implementation of a scalable, cloud-based data architecture supporting the analytics and reporting needs of a private equity fund management firm. This role focuses on building a robust, high-performance data platform leveraging Azure Synapse, Snowflake, dbt, and Dagster. Open to...

  • Data Architect

    3 weeks ago

    Toronto, Canada JamLabs Data Science Full time

    OverviewWe are seeking an experienced Data Architect to lead the design and implementation of a scalable, cloud-based data architecture supporting the analytics and reporting needs of a private equity fund management firm. This role focuses on building a robust, high-performance data platform leveraging Azure Synapse, Snowflake, dbt, and Dagster. Open to...

  • Senior Software Engineer

    3 weeks ago

    Toronto, Canada VAST Data Full time

    Senior Software Engineer VAST Data is looking for a Core Database Developer (Database Internals) to join our growing team. This is a great opportunity to be part of one of the fastest‑growing infrastructure companies in history, at the center of the revolution in artificial intelligence. Key Responsibilities Design & Develop Database Components: Implement...

  • Senior Software Engineer

    4 weeks ago

    Toronto, Canada VAST Data Full time

    Senior Software Engineer VAST Data is looking for a Core Database Developer (Database Internals) to join our growing team. This is a great opportunity to be part of one of the fastest‑growing infrastructure companies in history, at the center of the revolution in artificial intelligence. Key Responsibilities Design & Develop Database Components: Implement...

  • Senior Software Engineer

    4 weeks ago

    Toronto, Canada VAST Data Full time

    Senior Software Engineer VAST Data is looking for a Core Database Developer (Database Internals) to join our growing team. This is a great opportunity to be part of one of the fastest‑growing infrastructure companies in history, at the center of the revolution in artificial intelligence. Key Responsibilities Design & Develop Database Components: Implement...

  • Associate (Co-op Winter Term) - Data Analytics & Engineering

    1 week ago

    Toronto, Ontario, Canada Data SEA Consulting Full time $60,000 - $80,000 per year

    Data SEA Consulting - Associate Co-op – Data Analytics & EngineeringCompany DescriptionAt Data SEA Consulting, we help mid-sized businesses unlock the power of their data. Our clients — from private equity funds to independent business owners — rely on us to design and implement modern analytics solutions that drive measurable value. We develop...

  • Forward Deployed Engineers

    2 days ago

    Toronto, Ontario, Canada Data Intellect Full time US$80,000 - US$150,000 per year

    Company Description At Data Intellect it has never been just about data or technology, they are our tools. It's about human intellect, collaboration and providing solutions for the most complex of challenges.We do this by living the [DI] code:We are Problem Solvers who are Humble, possess a Can-do Attitude with a focus on Togetherness."We are not big on...