GCP Data Migration Engineer – PySpark
2 days ago
Brampton, ON, Canada
Astra-North Infoteck Inc.
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
GCP Data Migration Engineer – PySpark & Salesforce Data Migration
GCP Data Migration Engineer – PySpark & Salesforce Data Migration
Required Skills & Experience: Must Have (4-5 years minimum):
Strong hands-on experience with GCP Dataproc and Apache Spark (PySpark preferred)
Python scripting for custom data transformations and business logic
Proficiency in BigQuery (SQL, table design, partitioning, optimization)
Experience building ETL pipelines in GCP ecosystem
Solid understanding of Salesforce data model and Salesforce APIs (Bulk API, REST API)
Experience with GCS for file handling and cloud storage patterns
Preferred:
Exposure to GitLab CI/CD (understanding pipeline YAML, not building from scratch)
Prior Salesforce data migration projects (especially Health Cloud or Life Sciences Cloud)
Knowledge of DLP implementation and PII handling best practices
Healthcare data compliance knowledge (PIPEDA, HIPAA)
Technical Depth:
Ability to debug complex Spark jobs and resolve memory/performance issues
Strong SQL skills for data validation and reconciliation
Comfortable working with 70+ object schemas and complex relationships
Required Skills & Experience: Must Have (4-5 years minimum):
Strong hands-on experience with GCP Dataproc and Apache Spark (PySpark preferred)
Python scripting for custom data transformations and business logic
Proficiency in BigQuery (SQL, table design, partitioning, optimization)
Experience building ETL pipelines in GCP ecosystem
Solid understanding of Salesforce data model and Salesforce APIs (Bulk API, REST API)
Experience with GCS for file handling and cloud storage patterns
Preferred:
Exposure to GitLab CI/CD (understanding pipeline YAML, not building from scratch)
Prior Salesforce data migration projects (especially Health Cloud or Life Sciences Cloud)
Knowledge of DLP implementation and PII handling best practices
Healthcare data compliance knowledge (PIPEDA, HIPAA)
Technical Depth:
Ability to debug complex Spark jobs and resolve memory/performance issues
Strong SQL skills for data validation and reconciliation
Comfortable working with 70+ object schemas and complex relationships