Data Engineer – GCP

4 weeks ago

Old Toronto, Canada ProViso Staffing Full time
Story Behind the Need:

• Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end
• Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to ensure data is effectively shaped – stage: through proof of concept, current coordination with vendor partners and ensuring their technologies align to ours, early stages and ramping up

Candidate Value Proposition:

• The successful candidate will have the opportunity to gain exposure to advanced technologies in big data analytics, such as Spark, GCP, Kafka, MongoDB; work in a top 5 Canadian Bank.
• An inclusive and collaborative working environment that encourages creativity, curiosity, and celebrate success
• Exposure to different business lines where analytics techniques are being applied
• Assignment in hands-on practical projects which provide an opportunity to gain new knowledge and develop skills

Typical Day in Role:

• Collaborate with business lines and other stakeholders and identify opportunities to drive business value by leveraging data engineer.
• Efficiently handle large volumes of structured and unstructured data through ingestion, modeling, transformation, and storage across diverse data stores. Leverage distributed computing tools (e.g., Spark, Cloud) for analysis, data mining, and modeling
• Collaborate with operation, and other analytics teams to deploy models and automate pipelines / workflows in production across different channels and platforms
• Work with the team to design the project architecture and road map.
• Create and apply model and algorithm testing strategies to measure the effectiveness of models and make ongoing changes.
• Prepare detailed documentation to outline data sources, models, and algorithms used and developed.
• Present results to business line stakeholders and help implement real world data-driven changes.

Candidate Requirements/Must Have Skills:

• 10+ years of progressive experience as Data Engineer, Software Developer, or similar technical roles.
• 5+ years’ experience with SQL/NOSQL and relational databases technologies/concepts for both querying/manipulating datasets and managing /controlling databases.
• 3+ years’ experience with Google Cloud Platform about Data Ingesting and on-prem to cloud environment data replication.
• 5+ years’ combined experience programming in Python or equivalent languages (Scala, Java), and tools such as Spark, Airflow (please list which)

Nice-To-Have Skills:

• Experience with DBT (Data Building Tool)
• Experience in creating Docker images
• Experience / knowledge of MongoDB
• Experience from banking / financial services

Soft Skills Required:

• Excellent written, verbal, and interpersonal skills for executive level communication and collaboration
• Able to work in a fast-paced, constantly evolving environment and manage multiple priorities.
• Pragmatic and capable of solving complex issues.
• Experience working with a variety of cross-functional teams

Education:

• Bachelor’s Degree or equivalent in in Computer Science, Engineering, or relevant field.

Best VS. Average Candidate:

• GCP, Python and Spark experience best for programming

Candidate Review & Selection:

• MS Teams Video Interviews:
o 1st – HM interview round – 45 minutes max
o 2nd – Panel technical round – 45 minutes max – potential exercise / caste study component

Job Details

12048

Contract

4 months

Toronto

#J-18808-Ljbffr

  • GCP Data Engineer

    3 weeks ago

    Toronto, Canada Atlantis IT Group Full time

    Role name: GCP Data EngineerRole Description: Ability to lead on GCP team and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong migration experience of Hadoop cluster to Google...

  • GCP Data Engineer

    2 weeks ago

    Toronto, Canada Atlantis IT Group Full time

    Role name: GCP Data Engineer Role Description: Ability to lead on GCP team and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong migration experience of Hadoop cluster to Google Cloud...

  • GCP Data Engineer

    2 weeks ago

    Toronto, Canada Atlantis IT Group Full time

    Role name: GCP Data EngineerRole Description: Ability to lead on GCP team and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong migration experience of Hadoop cluster to Google...

  • GCP Data Engineer

    2 weeks ago

    Toronto, Canada Atlantis IT Group Full time

    Role name: GCP Data EngineerRole Description: Ability to lead on GCP team and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong migration experience of Hadoop cluster to Google...

  • GCP Data Engineer

    2 weeks ago

    Toronto, Canada Atlantis IT Group Full time

    Role name: GCP Data Engineer Role Description: Ability to lead on GCP team and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong

  • GCP Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Atlantis IT Group Full time

    Role name:GCPData Engineer Role Description: Ability to lead onGCPteam and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong

  • GCP Data Engineer

    2 weeks ago

    Toronto, ON, Canada Atlantis IT Group Full time

    Role name: GCP Data EngineerRole Description: Ability to lead on GCP team and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong migration experience of Hadoop cluster to Google...

  • GCP Data Engineer

    2 weeks ago

    Toronto, ON, Canada Atlantis IT Group Full time

    Role name: GCP Data EngineerRole Description: Ability to lead on GCP team and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong migration experience of Hadoop cluster to Google...

  • GCP Data Engineer

    2 weeks ago

    Toronto, ON, Canada Atlantis IT Group Full time

    Role name: GCP Data EngineerRole Description: Ability to lead on GCP team and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong migration experience of Hadoop cluster to Google...

  • Data Engineer – GCP

    1 week ago

    Old Toronto, Ontario, Canada ProViso Staffing Full time

    Story Behind the Need: • Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end• Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to ensure...

  • (Urgent) GCP Data Engineer

    1 week ago

    Toronto, Ontario, Canada Atlantis IT Group Full time

    Role name: GCP Data EngineerRole Description: Ability to lead on GCP team and Extensive experience in managing and leading Data Engineer team .Responsible & accountable for doing high level and detailed technical design and solution. Developing data ingestion framework for different sources Strong migration experience of Hadoop cluster to Google...

  • Lead GCP Data Engineer

    1 month ago

    toronto, Canada Viva Tech Solutions Full time

    10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud

  • Lead GCP Data Engineer

    4 weeks ago

    Toronto, Canada Viva Tech Solutions Full time

    10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud

  • Lead GCP Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Viva Tech Solutions Full time

    10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud

  • Data Engineer – GCP

    2 months ago

    Old Toronto, Canada ProViso Staffing Full time

    Story Behind the Need: • Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end• Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to...

  • Data Engineer – GCP

    2 months ago

    Old Toronto, Canada ProViso Staffing Full time

    Story Behind the Need: • Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end• Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to...

  • Data Engineer – GCP

    2 months ago

    Old Toronto, Canada ProViso Staffing Full time

    Story Behind the Need: • Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end• Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to...

  • Data Engineer – GCP

    4 weeks ago

    Old Toronto, Canada ProViso Staffing Full time

    Story Behind the Need: • Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end• Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to...

  • Data Engineer – GCP

    4 weeks ago

    Old Toronto, Canada ProViso Staffing Full time

    Story Behind the Need: • Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end• Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to...

  • Lead GCP Data Engineer

    2 months ago

    Toronto, Canada Viva Tech Solutions Full time

    10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developerExperience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.Experience with Google...