Back-End Data Engineer (Big data/ Cloud)
Tasks
- Build data ingestion pipelines
- Design high-level system architecture
- Develop low latency services
- Implement end to end data feed services
- Lead discovery and design phases
- Migrate legacy Hive pipelines to public cloud
- Orchestrate data workflows
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Hive | Apache Spark | BigQuery | Data pipeline | Dataproc | GCP | Low Latency | Low-Latency Systems | Service Implementation | Workflow Orchestration
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States12h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeMentorshipEntry-level InternshipBoston, MA, United States12h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R12h ago
-
HPG Big Data Engineer / Senior-Level USD 119K-164KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsSenior-level Full TimeNashville, TN, United States14h ago
-
kdb+ Contractor (Capital Markets) USD 150K-200KAWS | Azure | Electronic Trading | GCP | Kdb PlusContract opportunities | On site work 5 days per week | Permanent opportunitiesSenior-level ContractNew York, NY, United States15h ago
-
Senior kdb+ Engineer USD 150K-200KAI Tooling | AWS | Azure | Capital Markets | Electronic TradingFlexible holiday allowance | Healthcare and wellbeing | Hybrid working | Leadership development | Paid certificationsSenior-level Full TimeNew York, NY, United States15h ago
-
Amazon S3 | Automation | Data Engineering | Data Modeling | Data Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton17h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI Integration | AWS | Airflow | Apache Spark | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …17h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …17h ago
-
Senior Machine Learning Engineer USD 229K-360KAB Testing | AWS SageMaker | Airflow | Amazon S3 | Apache FlinkDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California1d ago
-
Senior AI Data Engineer USD 155K-185KApache Airflow | Apache Spark | Azure Synapse | BigQuery | ClickHouseEmployer paid Medical Dental Vision Insurance | Flexible paid time off | Manager check ins | Paid cell phone and service | Paid parental leaveSenior-level Full TimeRemote - United States R1d ago
-
Software Engineer, Data Infrastructure USD 155K-185KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeMountain View, CA1d ago
-
Senior Staff Software Engineer - Data Platform USD 200K-250KAWS Glue | AWS IAM | Amazon EMR | Amazon S3 | AmundsenDevelopment dollars | Employee stock purchase program | Family-forming benefits | Financial coaching | Flexible time offSenior-level Full TimeRemote, USA R1d ago
-
Senior Staff Software Engineer - Data Platform USD 200K-250KAWS EMR | AWS Glue | AWS IAM | AWS S3 | Apache AirflowDevelopment dollars | Financial coaching | Flexible remote work | Flexible time off | Free therapy sessionsSenior-level Full TimeRemote, USA R1d ago
-
AWS | Airflow | Ansible | Apache Spark | ArgoCDAdditional vacation days | English courses | Flexible remote options | Health insurance | Hybrid work optionsMid-level Full TimeGeorgia1d ago
-
Gen AI Engineering Analyst - Vice President USD 113K-170KAWS | Accuracy | Apache Kafka | Apache Spark | Azure401k | Accident insurance | Disability insurance | Life insurance | Medical, dental, and vision coverageExecutive-level Full Time14000 CITI CARDS WAY BUILDING C …1d ago
-
Senior Agentic AI Engineer USD 83K-203KArtificial Intelligence | Azure OpenAI | Cloud Computing | Code review | Data PipelinesDental insurance | Medical insurance | Paid time off | Retirement savings options | Vision insuranceSenior-level Full TimeWork At Home-Texas, United States1d ago
-
Lead Data Engineer USD 131K-220KAWS | Azure | Binary logging | CI/CD | CloudFormation401k contribution | Background check | Dental insurance | Medical insurance | Non Disclosure AgreementSenior-level Full TimeAF-WI Madison Natl HQ, United States1d ago
-
Cloud Cost Optimization | Cost Optimization | Data Governance | Data Security | Data Streaming401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSpringdale, AR Terminal Office - Springdale, …1d ago
-
Associate Data Engineer II USD 85K-115KBigQuery | Data Pipelines | Data Quality | Data Warehousing | Google CloudOn-call rotation | Work from homeMid-level Full TimeChattanooga, TN, United States1d ago
-
Associate Data Engineer I USD 85K-112KBigQuery | Data Pipelines | Data Warehousing | Google Cloud | PythonMentorship | On-call rotation | Remote work from homeMid-level Full TimeChattanooga, TN, United States1d ago
-
Mid-level Full TimeGH Office: San Antonio, TX (9903 …1d ago
-
Big Data | Data Governance | Data Security | Data Streaming | Data Visualization401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSpringdale, AR Terminal Office - Springdale, …1d ago
-
Lead Data Engineer USD 224KApache Airflow | Apache Beam | BigQuery | CI/CD | CMEK401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Senior Data Engineer USD 124K-271KApache Airflow | DBT | Dagster | Data Modeling | Data QualityHealth benefits | Hybrid work option | Remote work option | Work-life balance supportSenior-level Full TimeSan Jose (CA), United States1d ago