GCP Data Engineer
Chicago, IL; Chicago, Il; Chicago, IL; Chicago, IL; Chicago, IL; Chicago, IL
R
A USD 123K-178K (estimate) Mid-level Full Time
Tasks
- Adopt CI/CD and DevOps best practices
- Build data models for Data Lakes and Warehouses
- Collaborate with analytics and machine learning teams
- Design batch data pipelines
- Design streaming data pipelines
- Develop SQL for transformation and validation
- Ensure fault tolerant data pipelines
- Implement data quality checks and anomaly detection
- Implement medallion bronze silver gold architecture
- Implement secure data access with IAM
- Ingest data using Pub Sub Dataflow and Cloud Storage
- Migrate legacy ETL to dbt
- Optimize BigQuery schemas and partitioning
- Optimize pipelines for performance and scalability
- Process data with Python and Apache Beam
- Set up monitoring logging and alerting
- Transform data with BigQuery dbt and Python
- Use Git for version control and automated deployments
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Beam | Apache Spark | BigQuery | CI/CD | Cloud Build | Cloud Dataflow | Cloud Storage | Cloud platform | DBT | DevOps | Git | GitHub Actions | Google Cloud | Google Cloud Platform | IAM | Jenkins | Pub/Sub | Python | SQL | Talend
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Data Engineer USD 109K-164KAI Services | Azure AI | Azure AI Services | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeAustin, Texas, USA R10h ago
-
Senior-level Full TimeRemote, Canada; Computer/Software; Canada, Canada; Remote, … R13h ago
-
Cloud Software Engineer 3 - (Cloud, Hadoop, Java) USD 228K-278KAnsible | Apache Kafka | Apache Lucene | Apache Solr | Avro401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeFort Meade, Maryland R14h ago
-
API Design | Algorithm Optimization | Backend Services | Cloud Functions | Cloud platformAsynchronous culture | Laid-back atmosphere | Portfolio support | Remote workSenior-level Full TimeAnchorage, AK, USA R23h ago
-
Senior Data Engineer USD 122K-161KAPI Integration | AWS | Apache Beam | Apache Flink | Apache SparkRemote workSenior-level Full TimeUnited States R1d ago
-
AI Software Engineer USD 160K-250KAWS | Agent Orchestration | Async Python | CI/CD | Context ManagementEquity awards | Health insurance | Performance based cash bonus | Remote work opportunityMid-level Full TimeNew York, New York, United States R1d ago
-
Mid-level Full TimeUSA VA Home Office (VAHOME), United … R1d ago
-
MLOps Automation Engineer Lead USD 77K-154KAWS | AWS EKS | Ansible | Backup | Business ContinuityFlexible work arrangement | Work from homeSenior-level Full TimeEaston Ops Cols C Oh, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer-Nordic OMOP USD 93K-163KAWS | Azure | CI/CD | Data Marts | Data ModelingChildcare discounts | Comprehensive medical, dental and vision benefits | Continued education and training | Discounts to wellness centers | Employer-funded pension planSenior-level Full TimeRemote - VA, United States R1d ago
-
Data Engineer, Senior USD 77K-176KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, GA, Atlanta (575 Morosgo Drive … R1d ago
-
Embedded Robotics Engineer USD 125K-145KAutonomous Vehicles | C++ | Concurrent Systems | Control | Critical softwareMentorship | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Sr. Linux Systems Engineer - Object Storage (Remote) USD 140K-215KAWS S3 | Ansible | Chef | ELK Stack | GoEmployee networks | Paid adoption leave | Paid parental leave | Professional development opportunities | Remote workSenior-level Full TimeUSA CA Remote, United States R1d ago
-
AI Solution Engineer USD 150K-170KA/B | A/B Testing | AI Foundry | Access Management | Agent OrchestrationSenior-level Full TimeRemote, FL, United States R1d ago
-
Mid-level Full TimeRemote-Texas, United States R1d ago
-
ML Engineer, Analyst USD 107K-133KAWS | Azure | CI/CD | Embeddings | Language ModelsEducational assistance and training programs | Health and wellness benefits | Hybrid schedule | Paid Holidays | Paid sick daysNone Full TimeNew Jersey Office - 210 Hudson … R1d ago
-
AWS | Agile | Azure | Data Modeling | Data QualityCoaching | Employee engagement | Hybrid work | Mentorship | NetworkingEntry-level Full Time InternshipColumbus OH-Worth Ave, United States R1d ago
-
AWS | Agile | Azure | Data Mining | Data ModelingCoaching | Employee engagement | Mentorship | Networking | VolunteerismEntry-level Full Time InternshipHartford CT- Home Office, United States R1d ago
-
AI Engineer USD 82K-172KAPI Development | AWS | Agile | Azure | C++Flexible time off | Learning resourcesSenior-level Full Time999 REMOTE, United States R1d ago
-
AI Solutions Engineer Lead USD 243K-381KAPI Design | API access | Agentic AI | Agile | Agile Framework SAFe401k match | Dental insurance | Financial education resources | Health insurance | Incentive bonus programsSenior-level Full TimeGA-ATLANTA, 740 W PEACHTREE ST NW, … R1d ago
-
Senior AI Engineer USD 90K-150KAPI Integration | AWS | AWS Bedrock | Agentic Workflows | Containers401k match | Health insurance | PTO | Stock options | Stock purchase planSenior-level Full TimeRemote - United States R1d ago
-
Artificial Intelligence Engineer USD 200K-250KAWS | CI/CD | Code Interpreter | Data parallelism | Deep learningMid-level Full TimeCalifornia, United States - Remote R1d ago
-
Data Engineer USD 190K-240KAWS | Airflow | CI/CD | Docker | DynamoDBCollaboration with detection engineers | Equity | Remote-first | Small high context teamSenior-level Full TimeCalifornia, United States - Remote R1d ago
-
Mid-level Full TimeCenter, Center District, IL R1d ago