Hadoop Developer

2 days ago

Mississauga, Ontario, Canada TekFormix Full time $1,456,000 - $1,468,800 per year

Responsibilities

  • Design, develop, and implement big data solutions using Hadoop, Spark, Apache Hive, and related technologies.
  • Build and maintain ETL pipelines utilizing tools such as Informatica, Talend, and custom scripting (Python, Shell Scripting, Bash).
  • Develop data models and optimize database design for data warehouses using SQL Server, Oracle, and Azure Data Lake.
  • Integrate diverse data sources including Linked Data, RESTful APIs, and cloud platforms like AWS and Azure.
  • Collaborate with cross-functional teams to gather requirements and translate them into scalable technical solutions.
  • Perform data analysis and modeling to support analytics initiatives; assist in model training where applicable.
  • Ensure data quality, security, and compliance standards are maintained throughout the development lifecycle.
  • Participate in Agile development processes to deliver iterative improvements efficiently.
  • Write clear documentation for data workflows and system architecture to facilitate ongoing maintenance and enhancements.

Skills

  • Strong expertise in Hadoop ecosystem components such as Apache Hive, Spark, and related big data technologies.
  • Proficiency with cloud platforms including AWS (Amazon Web Services) and Azure Data Lake.
  • Experience with Java, Python, VBA, Bash (Unix shell), Shell Scripting for automation and development tasks.
  • Solid understanding of SQL Server, Oracle databases, Data Warehouse design principles, and ETL processes.
  • Familiarity with Looker or other BI tools for reporting and visualization purposes.
  • Knowledge of Informatica, Talend for data integration workflows.
  • Experience working with Linked Data sources and RESTful APIs for data ingestion.
  • Skills in database design, analysis techniques, model training, and analytics methodologies.
  • Ability to work within Agile teams while managing multiple priorities effectively. This position offers an opportunity to work on cutting-edge big data projects within a dynamic environment that values innovation and continuous learning. The ideal candidate will possess a strong technical foundation combined with excellent problem-solving skills to contribute meaningfully to our organization's success.

Job Type: Full-time

Pay: $70,000.00-$120,000.00 per hour

  • Java Developer with Spark

    1 week ago

    Mississauga, Ontario, Canada Synechron Full time $100,000 - $110,000 per year

    Overview:We are looking for a talentedJava/Spark Developerto join our team and contribute to our big data initiatives. The ideal candidate will have a strong foundation in Java and Spark, along with hands-on experience in Hadoop, Hive, Impala, and SQL. You will play a key role in developing and optimizing data processing applications to handle large...

  • Applications Development Technology Lead

    2 weeks ago

    Mississauga, Ontario, Canada Citi Full time $120,000 - $170,800 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewThe Applications Development Technology Lead Analyst is a senior...

  • Python Developer

    7 days ago

    Mississauga, Ontario, Canada Compunnel Inc. Full time $90,000 - $120,000 per year

    Key Responsibilities:Develop, test, and maintain robust APIs using Python frameworks such as Flask or Django.Design, develop, and optimize SQL queries and stored procedures for data extraction, transformation, and loading (ETL) processes.Build and maintain data warehousing solutions to support data analysis and reporting requirements.Collaborate with data...

  • Big Data Lead Developer

    2 days ago

    Mississauga, Ontario, Canada Citi Full time $120,800 - $170,800

    We are seeking a highly skilled and experienced Big Data Lead Developer to join our team in Mississauga. This is a senior-level, individual contributor, position primarily responsible for establishing and implementing new or revised application systems and programs, in close coordination with the broader Technology team. The successful candidate will play a...

  • Senior Data Analytics Developer

    6 days ago

    Mississauga, Ontario, Canada Citi Full time $80,000 - $141,500 per year

    We are seeking a talented and experienced Data Analytics Developer to join our team. You will play a key role in designing, developing, and maintaining our next-generation data analytics platform. This involves building scalable and efficient data pipelines, optimizing query performance, and implementing robust solutions to enable real-time and historical...

  • Data Engineer with CLoud

    2 days ago

    Mississauga, Ontario, Canada Itech Enterprises Full time $80,000 - $120,000 per year

    Role DescriptionThis is a full-time on-site role for a Data Engineer with Cloud expertise, based in Mississauga, ON. The Data Engineer will be responsible for designing, developing, and optimizing data pipelines and systems, creating effective ETL processes, implementing data models, managing data warehousing solutions, and performing data analytics to...

  • Senior Data Engineer

    7 days ago

    Mississauga, Ontario, Canada fc71e8c5-deda-48e9-b38c-23c0611c543b Full time $70,000 - $150,000 per year

    Key Responsibilities:Design, build, and maintain scalable and reliable ETL/ELT pipelines for structured and unstructured data.Architect and implement data lakes, data warehouses, and analytical data models using modern cloud technologies.Build and optimize distributed data processing systems using tools like Apache Spark, Databricks, Hadoop, Flink, Beam, or...

  • Senior Big Data Engineer

    2 days ago

    Mississauga, Ontario, Canada Citi Full time US$94,300 - US$141,500

    The Big Data Engineer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.Responsibilities:Partner with multiple management teams to ensure...

  • Senior Big Data Engineer

    2 days ago

    Mississauga, Ontario, Canada Citi Full time US$94,300 - US$141,500

    The Big Data Engineer is a senior level position responsible for establishing andimplementing new or revised application systems and programs in coordination with theTechnology team. The overall objective of this role is to lead applications systems analysisand programming activities.Responsibilities:Partner with multiple management teams to ensure...

  • ML Engineer Nearshore

    1 week ago

    Mississauga, Ontario, Canada BayOne Solutions Full time $120,000 - $140,000 per year

    Key Responsibilities:Design, develop, and maintain ETL/ELT pipelines for structured and unstructured data.Implement scalable data architectures using cloud platforms (AWS, GCP, Azure).Develop and optimize machine learning pipelines for training, validation, and deployment .Work closely with data scientists to productionize ML models using MLflow, TensorFlow,...