Big Data Developer

4 days ago

Toronto, Ontario, Canada Triton Digital Full time $120,000 - $180,000 per year

We are open to candidates in Ontario or Quebec.

Are you passionate about new technologies and looking to be part of a software development team that is constantly striving for innovation in a warm, relaxed, and stimulating environment?We are looking for a
Big Data Developer / Machine Learning Engineer
to join our "Audience" team.Our success depends on our ability to tackle challenges together. We are technology enthusiasts. Always on the lookout for the best tools and methods to do our work, we also place great importance on communication skills and team spirit.If you're interested in building Business Intelligence tools that leverage data generated by millions of audio streaming users, read on

You're an excellent candidate if you:

  • Are proficient in programming languages like Scala (an asset) and Python (a must).
  • Have already developed applications that prioritize high concurrency and short response times.
  • Have mastered data modeling and parallel processing concepts, and have solid knowledge of Big Data technologies (e.g., Apache Spark) and distributed data storage systems (e.g., Scylla DB).
  • Have advanced knowledge of containerization tools (Docker, Kubernetes, Red Hat Openshift) and cloud platforms (e.g., AWS).
  • Have experience with test-driven development (TDD) and are familiar with CI/CD tools such as GitHub Actions and Bamboo.
  • Have already designed and optimized data processing pipelines using tools like Airflow.
  • Have proven experience in Machine Learning engineering and operations applied to Big Data, and have worked with frameworks like Apache Spark for ML.
  • Use AI tools in your software development work.
  • Are autonomous and possess excellent problem-solving skills and analytical thinking.
  • Have developed in Agile/Scrum environments.
  • Have at least five years of professional experience as a Big Data developer.

Your responsibilities:

  • Develop new products/applications and enhance existing ones using Scala or other relevant technologies.
  • Participate in all phases of the software development lifecycle: planning, design, coding, testing, deployment, monitoring, support, documentation.
  • Write high-quality code to develop and maintain robust, large-scale applications.
  • Work closely with data scientists to understand their models and translate complex algorithms into scalable solutions.
  • Manage the lifecycle of machine learning models, including testing, deployment, and monitoring in production environments.
  • Maintain documentation of processes and best practices, so team members can easily understand and follow established protocols.
  • Collaborate cross-functionally with Big Data developers, Data Ops teams, and IT Ops to ensure seamless integration of ML solutions into the existing infrastructure.
  • Be an engaged and positive member of a self-organized, multidisciplinary Agile team.
  • Offer help and be open to asking for it in return.
  • Be receptive to others' ideas while communicating respectfully.
  • Work with the Product Manager and other product teams to help define the future solutions of the organization.
  • Recommend technological choices and be capable of supporting them.

  • Big Data Developer

    7 days ago

    Toronto, Ontario, Canada fc71e8c5-deda-48e9-b38c-23c0611c543b Full time $70,000 - $120,000 per year

    Job OverviewWe are seeking a dynamic and innovative Big Data Developer to join our data engineering team. In this role, you will harness the power of large-scale data processing and analytics to drive strategic insights and support business growth. Your expertise in big data technologies, cloud platforms, and data integration will be crucial in designing,...

  • Big Data Developer

    2 weeks ago

    Toronto, Ontario, Canada Tekshapers Full time $80,000 - $120,000 per year

    Job Title: Big data DeveloperLocation: Toronto, ONFull TimeTotal Experience: 8-10 yearsRole Description:• We are looking for a big data developer with hands on experience on developing APIs.• The candidate should also have knowledge of Kubernetes and worked as a Java developer.• The candidate should be able to exhibit strong coding skills in above tech...

  • Big Data Developer

    7 days ago

    Toronto, Ontario, Canada Accuro Full time $90,000 - $120,000 per year

    Job Tite: Big Data DeveloperLocation: Toronto, ON (Hybrid)Job Type: FTEJob Description:Primary Skill:• Min 5+ years in developing and optimizing Big Data applications using Java/Scala and Spark on Cloudera/HDP.• Experience in developing/designing micro-service architecture.• Proven hands-on experience in containerization – Docker, Kubernetes,...

  • Big Data Developer

    7 days ago

    Toronto, Ontario, Canada ehub global Full time $72,000 - $96,000 per year

    Role-Big-Data developerLocation- Toronto, ON (Onsite from day 1)JD:Experience: 8+ yearsBig Data: Apache Spark, Hadoop ecosystem(HDFS, Hive, Yarn).Programming : Expert in Scala and JavaBackend :Spring Boot, RESTful APIsDatabase : Microsoft SQL Server(MSSQL)Nice to have : Experience in migrating on-premise applications to cloud (Azure/AWS), familiarity with...

  • Big Data Developer

    2 weeks ago

    Toronto, Ontario, Canada Info Way Solutions Full time $80,000 - $120,000 per year

    Big Data Developer: (No of position – 1)JD:• Experience: 8+ years• Big Data: Apache Spark, Hadoop ecosystem(HDFS, Hive, Yarn).• Programming : Expert in Scala and Java• Backend :Spring Boot, RESTful APIs• Database : Microsoft SQL Server(MSSQL)• Nice to have : Experience in migrating on-premise applications to cloud (Azure/AWS), familiarity with...

  • Lead Big Data Developer

    1 week ago

    Toronto, Ontario, Canada Vybog Full time $120,000 - $180,000 per year

    OverviewAre you interested in building the next-generation platform that handlespetabytes of dataand powersdata insight creationusing cutting-edgedata science technologies?Are you excited about leveragingBig Data,AI / Machine Learning, andData Analyticsto deliver actionable insights?We are adynamic team of top-notch engineersdedicated to making a dent in...

  • Big Data Developer

    2 weeks ago

    Toronto, Ontario, Canada Smart IT Frame LLC Full time $80,000 - $120,000 per year

    Role :Bigdata(Spark,Scala), Java,Sql,Unix,OCPLocation :TorontoJD:6 - 0 years of experience in Big Data technologies, especially Spark and Scala.Strong programming skills in Java and Scala.Proficient in writing complex SQL queries and working with relational databases.Hands-on experience with Unix/Linux environments and shell scripting.Oracle Certified...

  • Consultant, Big Data Development

    7 days ago

    Toronto, Ontario, Canada CIBC Full time $80,000 - $120,000 per year

    We're building a relationship-oriented bank for the modern world. We need talented, passionate professionals who are dedicated to doing what's right for our clients.At CIBC, we embrace your strengths and your ambitions, so you are empowered at work. Our team members have what they need to make a meaningful impact and are truly valued for who they are and...

  • Senior Data Engineer – Big Data

    7 days ago

    Toronto, Ontario, Canada AstraNorth Full time $120,000 - $180,000 per year

    • Exp Required: 10EngineerSkills Required: Agile Way of Working Digital : Python Digital : Bigdata and Hadoop Ecosystem - MapR PL/SQLJob Description: Required Technical Skills-10 years of experience in designing and implementing the applications.8 year of experience in Spark, Scala, and Java8 years of experience in SQL Server RDBMS.Knowledge of...

  • Big Data Platform Engineer

    2 weeks ago

    Toronto, Ontario, Canada CISPL Full time $110,000 - $135,000 per year

    Big Data Platform EngineerPosition OverviewWe are looking for someone armed with a strong tool-kit to develop and maintain technical solutions that adhere to engineering and architectural design principles while meeting business requirements. You'll be a technology owner providing technical expertise with a focus on efficiency, reliability, scalability, and...