Cloud Data Engineer

2 weeks ago

Montréal, Canada Experis Full time
Cloud Data Engineer
Contract Term: 12 months, renewable
Work Location: Montreal, QC; Hybrid, 3 days onsite per week (some flexibility), the other days remote
Our client, a global leading consulting firm, is looking for a Cloud Data Engineer.
Key skills: data engineer, SQL, Data warehouse, Python, PySpark, Databricks
Nice to have: Snowflake
This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.
The Role:
  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Data Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Requirements:
  • 5+ years Python coding experience.
  • 5+ years - SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.
Ingénieur de données cloud
Durée du contrat : 12 mois, renouvelable
Lieu de travail : Montréal, QC ; hybride, 3 jours sur place par semaine, les autres jours à distance
Notre client, un cabinet de conseil de premier plan à l'échelle mondiale, recherche un ingénieur de données cloud.
Compétences clés : ingénieur de données, SQL, entrepôt de données, Python, PySpark, Databricks
Atouts : Snowflake
Ce poste est destiné à un ingénieur de données cloud ayant une expérience en Python, Pyspark, SQL et en entrepôt de données pour les systèmes d'entreprise. Le poste requiert une personne à l'aise avec les utilisateurs professionnels et possédant une expertise en analyse commerciale.
Français:Le rôle :
• Créer et optimiser des pipelines de données pour une ingestion, une transformation et un chargement efficaces des données à partir de diverses sources tout en garantissant la qualité et l'intégrité des données.
• Concevoir, développer et déployer un programme Spark dans un environnement Databricks pour traiter et analyser de gros volumes de données.
• Expérience de Data Lake, DWH, Data Integration, Cloud, Design et Data Modelling.
• Maîtrise du développement de programmes en Python et SQL
• Expérience de la modélisation de données dimensionnelles d'entrepôt de données.
• Travailler avec des technologies basées sur des événements/streaming pour ingérer et traiter des données.
• Travailler avec des données structurées, semi-structurées et non structurées.
• Optimiser les tâches Databricks pour les performances et l'évolutivité afin de gérer les charges de travail de Big Data.
• Surveiller et dépanner les tâches Databricks, identifier et résoudre les problèmes ou les goulots d'étranglement.
• Mettre en œuvre les meilleures pratiques en matière de gestion, de sécurité et de gouvernance des données au sein de l'environnement Databricks. Expérience de la conception et du développement de solutions d'entrepôt de données d'entreprise.
• Maîtrise de la rédaction de requêtes SQL et de la programmation, y compris des procédures stockées et de la rétro-ingénierie des processus existants.
• Effectuer des revues de code pour garantir l'adéquation aux exigences, les modèles d'exécution optimaux et le respect des normes établies.
Exigences :
• 5 ans et plus d'expérience en codage Python.
• 5 ans et plus - Développement de grands ensembles de données basé sur SQL Server
• 5 ans et plus d'expérience dans le développement et le déploiement de pipelines ETL à l'aide de Databricks Pyspark.
• Expérience dans n'importe quel entrepôt de données cloud comme Synapse, Big Query, Redshift, Snowflake.
• Expérience dans l'entreposage de données - OLTP, OLAP, Dimensions, Facts et modélisation de données.
• Expérience antérieure dans la conduite d'une migration de plateforme de données cloud à l'échelle de l'entreprise avec de solides compétences en architecture et en conception.
• Expérience des architectures de données, de la messagerie et de l'analyse basées sur le cloud.
• Certification(s) cloud.
• Toute expérience avec Airflow est un plus.
Contact Information: Lam Guan

  • Cloud Data Engineer

    2 weeks ago

    Montréal, Canada Experis Full time

    Cloud Data Engineer Contract Term: 12 months, renewable Work Location: Montreal, QC; Hybrid, 3 days onsite per week (some flexibility), the other days remote Our client, a global leading consulting firm, is looking for a Cloud Data Engineer. Key skills: data engineer, SQL, Data warehouse, Python, PySpark, Databricks Nice to have: Snowflake This...

  • Cloud Data Engineer

    2 weeks ago

    Montréal, Canada Experis Full time

    Cloud Data Engineer Contract Term: 12 months, renewable Work Location: Montreal, QC; Hybrid, 3 days onsite per week (some flexibility), the other days remote Our client, a global leading consulting firm, is looking for a Cloud Data Engineer. Key skills: data engineer, SQL, Data warehouse, Python, PySpark, Databricks Nice to have: Snowflake This position is...

  • Cloud Network Engineer

    1 week ago

    Montréal, QC, Canada Soho Square Solutions Full time

    Role: Cloud Network Engineer Position: (1-Year Contract) Location : Montreal, QC Hybrid role Position Overview: We are seeking an experienced Cloud Network Engineer to join our Cloud Network Engineering team. The selected candidate will evaluate, design, and document networking solutions for public, private, and hybrid cloud infrastructures. This...

  • Cloud Network Engineer

    1 week ago

    Montréal, QC, Canada Soho Square Solutions Full time

    Role: Cloud Network Engineer Position: (1-Year Contract) Location : Montreal, QC Hybrid role Position Overview: We are seeking an experienced Cloud Network Engineer to join our Cloud Network Engineering team. The selected candidate will evaluate, design, and document networking solutions for public, private, and hybrid cloud infrastructures. This...

  • Analytics Engineer | Ingénieur Analytique

    1 week ago

    Montréal, QC, Canada Data Sciences Full time

    Summary We are looking for an Analytics Engineer to join our diverse and rapidly growing team in Montreal. The successful candidate will be responsible for designing and building dimensional models that will feed BI tools and facilitate reporting and analytics for technical and non-technical users alike. We are looking for big picture thinkers with strong...

  • Senior SAS and Cloud Administrator

    1 month ago

    Montréal, Canada C.G.I. Full time $100,000

    We are seeking a highly skilled and experienced Senior SAS and Cloud Administrator to join our team. The ideal candidate will have a strong background in SAS programming, administration, and cloud technologies, with a proven track record of delivering innovative solutions in complex environments. Key Responsibilities:SAS Administration:Manage and maintain...

  • Data Center Operator, Na

    6 months ago

    Montréal, Canada Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...

  • Data Analytics Sales Specialist, Google Cloud

    6 months ago

    Montréal, Canada Google Full time

    **Minimum qualifications**: - Bachelor's degree or equivalent practical experience. - 10 years of experience selling analytics, data warehousing, or data management software. - 7 years of experience planning, pitching, and executing a territory sales strategy. - Experience in working with developers and customer technical leads to build business cases and...

  • Data Analytics Sales Specialist, Google Cloud

    5 months ago

    Montréal, Canada Google Full time

    **Minimum qualifications**: - Bachelor's degree or equivalent practical experience. - 10 years of experience selling analytics, data warehousing, or data management software. - 7 years of experience planning, pitching, and executing a territory sales strategy. - Experience in working with developers and customer technical leads to build business cases and...

  • Analyst Data Governance and Quality

    6 months ago

    Montréal, Canada Canadian National Railway Full time

    At CN, we work together to move our company—and North America—forward. Be part of our Information & Technology (I&T) team, a critical piece of the engine that keeps us in motion. From enterprise architecture to operational technology, our teams use the agile methodology to automate and digitize our railroad ensuring our operations run optimally and...

  • Cloud Application Support Engineer

    1 week ago

    Montréal, QC, Canada hireVouch Full time

    Application Support Hero(ine) - Montreal (Hybrid) Combining sophisticated technology with exceptional people”…..Our client’s secret to attracting and retaining some of the strongest minds in technology. As an Application Support Specialist , you will be responsible for providing mission critical support for our proprietary trading applications and...

  • Senior Data Engineering Analyst

    4 weeks ago

    montréal, Canada National Bank Full time

    A career as a Data Engineering Analyst in the Digital Customer Experience Data Rotation Program means working closely with the Bank's sectors and business areas, as well as those working in analytics. This job allows you to have a positive impact on our organization by putting data learning at the heart of the sector/business domain.Your jobParticipate in...

  • Senior Data Engineering Analyst

    4 weeks ago

    montréal, Canada National Bank Full time

    A career as a Data Engineering Analyst in the Digital Customer Experience Data Rotation Program means working closely with the Bank's sectors and business areas, as well as those working in analytics. This job allows you to have a positive impact on our organization by putting data learning at the heart of the sector/business domain. Your job Participate in...

  • Senior Data Engineering Analyst

    1 month ago

    montréal, Canada National Bank Full time

    A career as a Data Engineering Analyst in the Digital Customer Experience Data Rotation Program means working closely with the Bank's sectors and business areas, as well as those working in analytics. This job allows you to have a positive impact on our organization by putting data learning at the heart of the sector/business domain.Your jobParticipate in...

  • Tier 2 Service Desk Specialist, Na

    6 months ago

    Montréal, Canada Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...

  • Azure Ingénieur De Données

    4 weeks ago

    Montréal, Canada C.G.I. Full time $85,000

    English will follow:Êtes-vous un ingénieur de données passionné désireux de construire des solutions de données robustes et évolutives ?Nous recherchons un ingénieur de données Azure talentueux pour rejoindre notre équipe dynamique et contribuer à notre mission de favoriser la prise de décision basée sur les données. Dans ce rôle, vous jouerez...

  • Data Center Operator, Na

    1 week ago

    Montréal, QC, Canada Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...

  • Team Lead

    6 months ago

    Montréal, Canada Cirque du Soleil Full time

    **Team Lead - Data Analyst** - Permanent position**We were born from an eclectic troop of performers. Come live the experience of being yourself every day to create the extraordinary.** **OUR MISSION** Since 1984, Cirque du Soleil Entertainment Group has been focusing on ever more creative and magical work in order to constantly push the limits of the...

  • Senior Analyst Data

    4 weeks ago

    montréal (dorval), Canada Air Canada Full time

    Description Being part of Air Canada is to become part of an iconic Canadian symbol, recently ranked the best Airline in North America. Let your career take flight by joining our diverse and vibrant team at the leading edge of passenger aviation. We are seeking a highly skilled Senior Analyst Data & Analytics (Data Developer) to join our dynamic team. The...

  • Senior Analyst Data

    1 month ago

    montréal (dorval), Canada Air Canada Full time

    Description Being part of Air Canada is to become part of an iconic Canadian symbol, recently ranked the best Airline in North America. Let your career take flight by joining our diverse and vibrant team at the leading edge of passenger aviation. We are seeking a highly skilled Senior Analyst Data & Analytics (Data Developer) to join our dynamic team. The...