Jr-Mid Level GCP Data Engineer
Tasks
- Build and support data processing pipelines in Hadoop
- Design and implement data flows with Spark Streaming and Flink
- Develop and maintain ETL pipelines across Hadoop and GCP
- Develop real-time streaming pipelines with Kafka
- Maintain data lake and platform environments
- Migrate on prem data and workloads to GCP
- Optimize pipeline performance
- Perform integration testing and production deployments
Perks/Benefits
- 401k
- Employee assistance program
- Health spending account
- Life insurance
- Long-term disability
- Medical/Dental/Vision
- Short-term disability
- Time off
- Transportation benefits
Skills/Tech-stack
Apache Flink | BigQuery | Cloud Composer | Cloud Storage | Cloud platform | Dataflow | Google Cloud | Google Cloud Platform | Hadoop | Kafka | PySpark | Python | Real Time | Real-time Processing | Spark Streaming | Time processing
Education
N/A
Roles
Related jobs
-
DevOps Engineer, Data & AI Platform USD 144K-180KAWS | Apache Airflow | Apache Kafka | Apache Spark | Bash401k match | Backup care | Dental insurance | Disability insurance | Employee resource groupsMid-level Full TimeUnited States R15h ago
-
Senior Data Engineer USD 109K-164KAccess Control | Agile | Azure | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Fully remote | Health spending account | Life insuranceSenior-level Full TimeRaleigh, North Carolina, USA R17h ago
-
Junior-Mid Level GCP Data Engineer USD 76K-80KBigQuery | Cloud Composer | Cloud Dataflow | Cloud Storage | Cloud platform401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilityEntry-level ContractChandler, Arizona, USA R18h ago
-
Sr. Embedded Engineer I, Edge Capture (6813) USD 140K-150KARM | Battery systems | C# | C++ | CSI Camera401k match | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, and vision insurance | Paid time offSenior-level Full TimeHybrid - Reston, VA R18h ago
-
Software Engineer II, Embedded USD 114K-170KBitbake | C++ | Concurrency | Continuous Deployment | Continuous integration401k match | Commuter benefits | Company paid life insurance | Company-paid Short Term Disability | Company-paid long term disabilityMid-level Full TimeKirkland, WA – Hybrid R19h ago
-
AI Scientist/Engineer II- School of Medicine, BMI USD 80K-100KArtificial Intelligence | Data Analysis | Data Documentation | Data Lakes | Data PipelinesWork from homeEntry-level Full TimeEmory Campus-Clifton Corridor R20h ago
-
Agentic AI Architect-Anthropic-US East USD 275K-365KAPIs | AWS Lambda | AWS SageMaker | Access Control | Access ManagementClient travel | Conference travelSenior-level Full TimeUSA - Remote R20h ago
-
Agentic AI Architect-Anthropic-US West USD 270K-345KAPIs | AWS Lambda | AWS S3 | AWS SageMaker | Agentic AISenior-level Full TimeUSA - Remote R20h ago
-
AI/Machine Learning Engineer USD 99K-225KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k Company Contributions | Career development | Company funded HRA | Employer-paid life insurance | Long-term disabilityMid-level Full TimeFt. Meade, MD; Laurel, MD R20h ago
-
Cleared ETL Data Engineer (Multi-Level) USD 90K-188KAWS | Apache NiFi | CI/CD | Data Cleansing | Data NormalizationPaid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeChantilly, VA R21h ago
-
AI Scientist USD 130K-200KAPI Integration | Access Controls | Anomaly Detection | Boosting | CI/CDFlexible work schedule | Work from home one day per weekSenior-level Full TimeNew York, NY R22h ago
-
AI Engineer USD 135K-180KAPI Integration | Automation platforms | Chatbots | Code Tools | Dashboard Development401k match | Dental insurance | Disability insurance | Employee Assistance Program (EAP) | Holiday paySenior-level Full TimeWestminster, CO R1d ago
-
Apache Spark | Azure Synapse | DAX | Data Lake | Data ModelingBirthday day off | Life insurance | Prepaid medicine | Work from homeMid-level Full TimeColombia, United States R1d ago
-
Software Engineer, Data Platform USD 130K-200KAccess Control | Alerting | ClickHouse | Data Protection | Distributed SystemsFlexible time off | Health insurance | Mentorship | Work from home budgetMid-level Full TimeHybrid - San Francisco, New York … R1d ago
-
Senior Data Engineer - Finance USD 170K-260KAirflow | DBT | Dagster | Data Modeling | Data QualityEquipment provided | Flexible time off | Healthcare | Learning opportunities | MentorshipSenior-level Full TimeHybrid - San Francisco, New York … R1d ago
-
Senior Data Engineer - GTM USD 170K-260KAirflow | DBT | Dagster | Data Modeling | Data QualityFlexible time off | Healthcare | Learning events | Mentorship | Work from home budgetSenior-level Full TimeHybrid - San Francisco, New York … R1d ago
-
Load Forecasting Data Scientist USD 86K-120KBig Data | Data Wrangling | Data munging | Data pipeline | Geospatial AnalyticsEmployee assistance program | Flexible work hours | Hybrid work environment | Paid time off | Professional developmentMid-level Full TimeWindsor, CT, 06095, USA R1d ago
-
DevOps (GitLab-based platform CICD 30*3 pipelines) USD 135K-240KAWS | Alerting | Ansible | Azure | CI/CDSenior-level Full TimeSan Jose, CA / Austin, TX-%LABEL … R1d ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R1d ago
-
AI Engineer USD 140K-182KCaching | Embeddings | Error Recovery | Evaluation | Fallback LogicCollaborate with small fast moving team | Competitive equity | Direct ownership | Full-time employment | Hybrid workMid-level Full TimeNew York, New York, United States R1d ago
-
Senior Data Engineer II USD 145K-207KAirflow | Alerting | BigQuery | CI/CD | CloudMeaningful greenfield work | Onsite visits up to four times per year | Remote work within United States | Work-life balanceSenior-level Full TimeUnited States - Remote R1d ago
-
Principal Solutions Engineer, Data & AI USD 175K-200KAPIs | CRM | Databricks | Delta Sharing | HIPAA401k | Company on site visits | Dental insurance | Fully remote | Health and wellness stipendSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Engineer USD 170K-210KAWS | AWS Neptune | Amazon Kinesis | Apache Airflow | Apache FlinkDental insurance | Family leave | Flexible paid time off | Free food and snacks | Health care planSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
Senior Agentic (AI) Engineer USD 160K-200KA/B | A/B Testing | AWS | Agent SDK | ArgoCDDental insurance | Family leave | Flexible paid time off | Free food and snacks | Health insuranceSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
AWS Glue | AWS Lambda | AWS S3 | Amazon RDS | Amazon RedshiftSenior-level Full TimeUnited States - Remote R1d ago