Senior Data Engineer

3 weeks ago


Toronto ON, Canada Tiger Analytics, LLC Full time

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.

The Data Engineer will be responsible for architecting, designing, and implementing advanced analytics capabilities. The right candidate will have broad skills in database design, be comfortable dealing with large and complex data sets, have experience building self-service dashboards, be comfortable using visualization tools, and be able to apply your skills to generate insights that help solve business challenges. We are looking for someone who can bring their vision to the table and implement positive change in taking the company's data analytics to the next level.

Responsibilities:

  • A technologist and engineer at heart and be comfortable in enabling new technology and being hands on with the execution of the strategy. They must exhibit a deep understanding of modern AWS Data stack and agile delivery models, demonstrated focus on building business data pipelines.
  • Functions as senior member of an agile team and helps drive consistent development practices, tools usage, common components, and patterns.
  • Direct the identification and recommendation of appropriate solutions.
  • Performs hands-on design and development with PySpark/Pandas/SQL, AWS Glue for ETL and Catalog, Datasync, Parquet files, Warehousing experience preferably with Snowflake and/or Redshift
  • Spends significant amount of time writing code and testing.
  • 8+ years of overall industry experience specifically in data engineering
  • 5+ years of experience building and deploying large-scale data processing pipelines in a production environment.
  • Strong experience in building ETL data pipelines and analysis using Python, SQL, and PySpark
  • In-depth knowledge of data engineering concepts, techniques, and best practices.
  • Creating and optimizing complex data processing and data transformation pipelines using python
  • Knowledge of programming languages in data engineering such as Python or PySpark
  • Experience with ETL tools and frameworks (e.g., Apache NiFi, Talend, AWS Glue, Azure Data Factory).
  • Knowledge of big data platforms like Snowflake, DBT, AWS Redshift, Postgres, MongoDB, and Hadoop
  • Experience with data pipeline and workflow management tools
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
  • Understanding of Datawarehouse (DWH) systems, and migration from DWH to data lakes/Snowflake
  • Understanding of ELT and ETL patterns and when to use each. Understanding of data models and transforming data into the models
  • Strong analytic skills related to working with unstructured datasets
  • Cloud certification (AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer) is a plus.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management
  • Experience supporting and working with cross-functional teams in a dynamic environment

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

#J-18808-Ljbffr
  • Senior Engineer, Data

    4 weeks ago


    Toronto, ON, Canada Deep Genomics Full time

    Deep Genomics aims to revolutionize drug development using artificial intelligence built to decode RNA biology and RNA therapeutics. Our proprietary AI platform enables us to decode the enormous complexity of RNA biology to find novel targets, mechanisms, and molecules that are not accessible through traditional methods. Founded in 2015, our...


  • Toronto, ON, Canada Lightci Full time

    Lightci (Light Consulting) is a full-service engineering & talent solution created for engineers, by engineers. We build and ship products for clients like Google, Meta, Brex, and Walmart - and help Fortune 500 companies grow by way of full team construction, staff augmentation, executive search, and tailored recruitment to address unique hiring needs. ...

  • Senior Data Engineer

    3 weeks ago


    Toronto, ON, Canada Enable International Full time

    Do you want to help design new ways of processing Enterprise scale data at speed, learn leading edge technologies, work on complex big-data algorithms, shape processes into a growing engineering organisation, all while helping to scale a Series D rocket ship to the next level? Enable is the SaaS rebate management platform that drives trusted relationships...


  • Toronto, ON, Canada Tiger Analytics Full time

    Tiger Analytics is an advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value and leadership have been recognized by various market research firms, including...


  • Toronto, ON, Canada Secoda Full time

    Full Time] Senior Software Engineer, Infrastructure at Secoda (United States) | BEAMSTART Jobs Senior Software Engineer, Infrastructure Full Time Remote Work Scale Secoda’s core cloud platform for high availability and performance globally Evolve our backend architecture/infrastructure for both cloud and on-premise deployments Provide input to...


  • Toronto, ON, Canada Enable Full time

    We're seeking an experienced Senior Data scientist to drive the creation of AI and ML products and tools within a prominent SAAS tech company. This pivotal applied AI product role will work to strategically integrate AI solutions across products and business operations. ML has allowed for vastly improved data insights and solutions, while the use of...

  • Senior Data Engineer

    3 weeks ago


    Toronto, ON, Canada Tiger Analytics, LLC Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...

  • Senior Specialist

    6 days ago


    Toronto, ON, Canada BDO Canada LLP Full time

    Senior Specialist, Algorithm Engineering page is loaded Senior Specialist, Algorithm Engineering Apply locations Toronto - Wellington St Edmonton - 103 St Calgary - 8th Ave SW Halifax - Mumford Rd Ottawa - Coventry Rd time type Full time posted on Posted 30+ Days Ago job requisition id JR1280 Putting people first, every day   BDO is a firm built on...

  • Senior Data Engineer

    1 month ago


    Toronto, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...


  • Toronto, Ontario, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...

  • Senior Data Engineer

    3 weeks ago


    Toronto, Canada Lorven Technologies Full time

    Job Title: Senior Data Engineer Job Location: Toronto, ON, Canada (visiting the office 3-4 days per week) Job Type: Contract 12+ Months Responsibilities: Must have overall 8+ Years of experience in Data Engineering with a bachelor’s degree Manage timelines/deliverables within the team towards the successful delivery of projects. ...


  • Toronto, ON, Canada Lightci Full time

    About us Lightci (Light Consulting) is a full-service engineering & talent solution created for engineers, by engineers. We build and ship products for clients like Google, Meta, Brex, and Walmart - and help Fortune 500 companies grow by way of full team construction, staff augmentation, executive search, and tailored recruitment to address unique hiring...


  • Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Senior Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...


  • Waterloo, ON, Canada Sun Life Financial Full time

    You are as unique as your background, experience and point of view. Here, you’ll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day,...

  • Software Engineer

    3 weeks ago


    Ajax, ON, Canada IIT Guwahati Alumni Association Full time

    Senior Software Engineer MaxLinear || MS Research Computer Technology IIT Delhi || B.Tech NIT Raipur Silver Medalist at MaxLinear Technologies Pvt. Principal Software Engineer at InsightSoftware, Hyderabad Software Engineer @InsightSoftware, There are multiple opening for SE,SSE,PSE for Backend, frontend and devops for 3+ yrs insightsoftware  is a...


  • Toronto, ON, Canada Badal Full time

    We are a boutique, rapidly growing, GCP (Google Cloud Platform) consulting company based out of Toronto. We work with GCP’s top customers (banking, telco, energy, retail, etc.) to help them with cloud transformation, security, analytics, ML, and data governance. Clients usually engage us to solve their most challenging business problems and help raise the...


  • Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Senior Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...


  • Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Senior Azure Data Engineer Location: Toronto, ON (Hybrid) Term: Fulltime • Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile. • Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL • Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. • Experience in Sqoop /...


  • Mississauga, ON, Canada Epsilon Solutions Ltd. Full time

    Role : Senior Data Engineer Location - Mississauga, ON (Hybrid with 3 days onsite) Type :Fulltime Required Skills Python (Very Strong) Pyspark (Strong) Azure (Strong) Snowflake (Intermediate) ETL/ELT pipelines (Strong) Primary Responsibilities Provide production support for Data Warehouse issues such data load problems, transformation translation...


  • Toronto, ON, Canada Hour Consulting Full time

    Our client, a rapidly growing Canadian Technology focused Consulting Agency renowned for its tech-forward approach, seeks an exceptionally skilled Senior Data Engineer. This is a six-month contract position with a strong potential for extension. Are you passionate about building robust and scalable data engineering solutions in the cloud? Join our...