Junior GCP Data Engineer
Tasks
- Build data pipelines in Hadoop and Google Cloud
- Design data flows with Spark Streaming and Flink
- Develop Spark processing pipelines with PySpark
- Develop real-time streaming pipelines with Kafka
- Integrate and deploy data pipelines to production
- Migrate on prem Hadoop workloads to GCP
- Optimize pipeline performance
- Perform integration testing and production deployment
Perks/Benefits
- 401k
- Employee assistance program
- Health spending account
- Life insurance
- Long-term disability
- Medical/Dental/Vision
- PTO vacation sick leave
- Short-term disability
- Transportation benefits
Skills/Tech-stack
Apache Flink | BigQuery | Cloud Composer | Cloud Dataflow | Cloud SQL | Cloud Storage | Cloud platform | Data Migration | Dataproc | Google Cloud | Google Cloud Platform | Hadoop | Kafka | PySpark | Python | Spark Streaming
Education
N/A
Related jobs
-
Cyber Software Engineer Staff (Embedded) USD 120K-224KBlue Team | C++ | CISSP | Code Analysis | Cybersecurity401k match | Education assistance | Employee assistance program | Flexible spending accounts | Flexible work schedulesSenior-level Full TimeOrlando, FL, US8h ago
-
DevOps Engineer, Data & AI Platform USD 144K-180KAWS | Apache Airflow | Apache Kafka | Apache Spark | Bash401k match | Backup care | Dental insurance | Disability insurance | Employee resource groupsMid-level Full TimeUnited States R15h ago
-
Senior Data Engineer USD 109K-164KAccess Control | Agile | Azure | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Fully remote | Health spending account | Life insuranceSenior-level Full TimeRaleigh, North Carolina, USA R17h ago
-
Junior-Mid Level GCP Data Engineer USD 76K-80KBigQuery | Cloud Composer | Cloud Dataflow | Cloud Storage | Cloud platform401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilityEntry-level ContractChandler, Arizona, USA R18h ago
-
Jr-Mid Level GCP Data Engineer USD 76K-80KApache Flink | BigQuery | Cloud Composer | Cloud Storage | Cloud platform401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractPhoenix, Arizona, USA R18h ago
-
Mid-level Full TimeAustin, Texas18h ago
-
Sr. Embedded Engineer I, Edge Capture (6813) USD 140K-150KARM | Battery systems | C# | C++ | CSI Camera401k match | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, and vision insurance | Paid time offSenior-level Full TimeHybrid - Reston, VA R18h ago
-
Production Engineer (Electrical Test) — Robotics USD 120K-160KAutomation | Battery Management | Battery Management System | Bring-up | CANMid-level Full TimeWatertown, MA19h ago
-
Advanced Cyber Security Analytics Engineer USD 90K-100KBash | Cloud Security | Data Mining | Hex editor | Network Protocols401k match | Health, dental, and vision | Paid time off | Professional development reimbursement | Referral bonusesSenior-level Full TimeSt. Louis, MO19h ago
-
Senior-level Full TimeUS,TX,Austin19h ago
-
Software Engineer II, Embedded USD 114K-170KBitbake | C++ | Concurrency | Continuous Deployment | Continuous integration401k match | Commuter benefits | Company paid life insurance | Company-paid Short Term Disability | Company-paid long term disabilityMid-level Full TimeKirkland, WA – Hybrid R19h ago
-
AI Scientist/Engineer II- School of Medicine, BMI USD 80K-100KArtificial Intelligence | Data Analysis | Data Documentation | Data Lakes | Data PipelinesWork from homeEntry-level Full TimeEmory Campus-Clifton Corridor R20h ago
-
Agentic AI Architect-Anthropic-US East USD 275K-365KAPIs | AWS Lambda | AWS SageMaker | Access Control | Access ManagementClient travel | Conference travelSenior-level Full TimeUSA - Remote R20h ago
-
Agentic AI Architect-Anthropic-US West USD 270K-345KAPIs | AWS Lambda | AWS S3 | AWS SageMaker | Agentic AISenior-level Full TimeUSA - Remote R20h ago
-
AI/Machine Learning Engineer USD 99K-225KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k Company Contributions | Career development | Company funded HRA | Employer-paid life insurance | Long-term disabilityMid-level Full TimeFt. Meade, MD; Laurel, MD R20h ago
-
Software Integration Engineer IV USD 130K-219KASIC | Ansible | Atlassian Confluence | Atlassian Jira | BashSenior-level Full TimeAnnapolis Junction, MD; Hanover, MD; Hanover, …20h ago
-
Microsoft Fabric Data Engineer USD 119K-234KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeErie, PA, United States21h ago
-
AWS Bedrock | CI/CD | CUI | Chunking | Data GovernanceGovernment furnished equipment | Mentorship | Remote work | US clearance support for CUI SPI environmentsEntry-level Full TimeMenlo Park, CA, United States21h ago
-
Cleared ETL Data Engineer (Multi-Level) USD 90K-188KAWS | Apache NiFi | CI/CD | Data Cleansing | Data NormalizationPaid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeChantilly, VA R21h ago
-
Embedded Systems Engineer (Medical Devices) USD 109K-160KAXI-Stream | AXI4 | AXI4 Lite | Altium Designer | Buildroot401k match | Dental insurance | Medical insurance | Paid Holidays | Paid vacationSenior-level Full TimeAshburn, VA22h ago
-
Senior-level Full TimeWashington, DC22h ago
-
Lead Software Engineer - Python/PySpark/AWS/Databricks USD 170K-189KAWS | Automated testing | Cause analysis | Cloud Architecture | Data EngineeringBackup childcare | Financial coaching | Health and wellness centers | Health care coverage | Mental health supportSenior-level Full TimeWilmington, DE, United States22h ago
-
AI Scientist USD 130K-200KAPI Integration | Access Controls | Anomaly Detection | Boosting | CI/CDFlexible work schedule | Work from home one day per weekSenior-level Full TimeNew York, NY R22h ago
-
Data Engineer USD 114K-190KData Modeling | Data Pipelines | Data Transformation | ETL | JavaScriptDependent life insurance | Disability insurance | Health insurance | Holiday pay | Learning and developmentSenior-level Full TimeUSA-VA-Herndon23h ago
-
Senior QuickSight Analytics Engineer USD 107K-179KAmazon QuickSight | Data Modeling | Data Pipelines | Data Quality | Data TransformationMentorship | Professional development | Travel 10 percentSenior-level Full TimeBaltimore, Maryland, United States; Rosslyn, Virginia, …23h ago