Back-End Data Engineer (Big data/ Cloud)
Tasks
- Build data ingestion pipelines
- Design high-level system architecture
- Develop low latency services
- Implement end to end data feed services
- Lead discovery and design phases
- Migrate legacy Hive pipelines to public cloud
- Orchestrate data workflows
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Hive | Apache Spark | BigQuery | Data pipeline | Dataproc | GCP | Low Latency | Low-Latency Systems | Service Implementation | Workflow Orchestration
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Analytics Engineer USD 147K-225KApache Airflow | BigQuery | DBT | Data Modeling | Data Visualization401k | Comprehensive benefits | Equity | Flexible time offSenior-level Full TimeUS Remote, Los Angeles, CA; San … R9h ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R12h ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R12h ago
-
Senior-level Full TimeCanada R12h ago
-
Data Engineer USD 95K-140KApache Spark | Automated testing | Azure Databricks | CI/CD | Data ModelingMid-level Full TimeUS Remote R15h ago
-
Analytics Engineer USD 150K-190KDBT | Data Governance | Data Modeling | Data Monitoring | Data Pipelines401k | Catered lunches | Dental insurance | Equity | Free coffee snacksMid-level Full TimeNYC Office15h ago
-
A/B | A/B Testing | AWS | Airflow | Amazon Redshift401k matching | Employee assistance program | Flexible time off | Flexible work arrangement | Paid HolidaysMid-level Full TimeRemote, US R16h ago
-
Associate AI Engineer USD 144K-180K.NET | APIs | ASPNet | AWS | Azure401k matching | Dental insurance | Hybrid work model | Medical insurance | Paid time offMid-level Full TimeIrving, TX R18h ago
-
Data Engineer USD 130K-165KAPI Development | Airflow | Amazon Redshift | Amazon S3 | AvroCollaborative work environment | Dental insurance | Equity | Health insurance | Retirement benefitsMid-level Full TimeWilmington, MA21h ago
-
Data Engineer USD 105K-130KAPIs | Data Governance | Data Modeling | Data Monitoring | Data Quality401k employer matching | Childcare reimbursement | Company events social hours | Company paid parking or MTS pass | Fertility treatment coverageSenior-level Full TimeSan Diego, CA, United States22h ago
-
Senior Software Engineer - San Francisco (Onsite) USD 130K-220KAWS | Amazon EMR | Amazon S3 | Apache Flink | Apache SparkFast-paced startup environment | Onsite work environment | Rapid hiring process feedback | Relocation supportSenior-level Full TimeSan Francisco, CA, US22h ago
-
Machine Learning Engineer USD 223K-260KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | BigQuery401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible vacationMid-level Full TimeNew York City, NY22h ago
-
Machine Learning Engineer USD 187K-260KA/B | A/B Testing | AWS | Amazon RDS | Amazon S3401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careMid-level Full TimeSan Francisco, CA23h ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus | Collaborative culture | Distributed-first environmentMid-level Full TimeCanada R23h ago
-
Lead Data Engineer – Snowflake USD 170K-216KAmazon S3 | Apache Airflow | Azure Data | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeUnited States23h ago
-
Manager, Investment Analytics and Technology USD 155K-180KAPI | Artificial Intelligence | Azure | Dashboard | Data GovernanceMid-level Full TimeNew York, New York, United States23h ago
-
Sr. Data Engineer - Data Engineer III USD 125K-198KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon RedshiftSenior-level Full TimePhiladelphia, Pennsylvania, United States1d ago
-
Senior Data Engineer, Strategic Partnerships & IMPACT360 USD 154K-209KAWS Glue | AWS Lake Formation | AWS Lambda | Amazon Athena | Apache AirflowSenior-level Full TimeSeattle, Washington, USA1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AWS | Access Control | Apache Spark | Azure | CI/CD401k retirement plan | Comprehensive benefits | Dental insurance | Employee assistance program | Medical insuranceSenior-level Full TimeUSA, TX, Work-at-Home, United States R1d ago
-
Senior-level Full TimeMcLean, VA, United States1d ago
-
Sales Data & Analytics Product Manager USD 131K-190KAmazon Web Services | Analytics reporting | Apache Airflow | Apache Kafka | Apache Spark401k | Bonus | Dental coverage | Holidays | Medical coverageMid-level Full TimeUS, MA, Wilmington, United States1d ago
-
ML/ML Ops Principal Engineer USD 139K-190KAWS | BigQuery | Classification | Cloud Computing | Cloud platformSenior-level Full TimeGA250 - Atlanta GA, United States1d ago
-
Senior Data Engineer USD 147K-199KAWS Glue | Access Management | Amazon Web Services | Apache Airflow | Apache Spark401k match | Paid time off | Remote work | Wellness programsSenior-level Full TimeUSA VA Falls Church - 3180 …1d ago
-
Data Engineer USD 128K-173KAWS Glue | Amazon Web Services | Apache Airflow | Apache Spark | Data Movement401k match | Flex work week | Paid time off | Remote work | Wellness benefitsMid-level Full TimeUSA VA Falls Church - 3180 …1d ago