Spark Data Engineer, Senior
Undisclosed Location - USA, VA, Chantilly, United States
USD 77K-176K Senior-level Full Time
Tasks
- Build Spark data pipelines
- Collaborate with cross-functional teams
- Create ETL pipelines for large data
- Deploy and maintain scalable data platforms
- Design data models for complex structures
- Develop Java Spark applications
- Develop PySpark applications
- Monitor and operate data processing systems
- Optimize distributed data processing
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Apache Spark | Database Modeling | Docker | ETL | Graph Database | Graph Databases | Graph Traversal Optimization | Graph database modeling | Graph traversal | Java | Kafka | Kubernetes | NoSQL | PostgreSQL | PySpark
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Data Engineer USD 100K-115KCrystal Reports | Data Warehouse | ETL | Oracle | Power BI401k matching | Accidental insurance | Critical illness insurance | Employee discount | Flexible spending accountMid-level Full TimeRomeoville, IL, United States5h ago
-
Data Engineer USD 114K-160KCribl | Data Modeling | Data Warehouse | Data analytics | Data pipeline401k match | Holiday pay | Medical, dental & vision coverage | Paid time offMid-level Full TimeHuntsville, AL, United States6h ago
-
20454 - Analytics Engineer x 2 GBP 40K-42KAzure Data | Azure Data Factory | Azure Synapse | Data Factory | Data ModelingFlexible working | Hybrid working | Training and coachingEntry-level Full TimeNational, National8h ago
-
Airflow | Apache Spark | CI/CD | Data Governance | Data LakehouseSenior-level ContractAustin, United States8h ago
-
Container Runtime | Kubernetes | Microservices | Observability | Performance TuningSenior-level Full TimeSan Jose, California, United States9h ago
-
Senior Software Engineer II, Storage (File & Block) USD 165K-242KBlock Storage | CSI | ClickHouse | Data durability | Distributed Storage401k match | Flexible PTO | Flexible spending account | Health savings account | Medical, dental, and vision insuranceSenior-level Full TimeSunnyvale, California17h ago
-
Senior Software Engineer II, Storage (File & Block) USD 165K-242KBlock Storage | CRD | CSI | ClickHouse | Control Plane401k employer match | Catered lunch | Childcare support | Flexible PTO | Flexible spending accountSenior-level Full TimeNew York, NY17h ago
-
Staff Software Engineer, Storage USD 188K-275KC++ | CSI | Ceph | Crash Consistency | Distributed Systems401k match | Dental insurance | Flexible PTO | Health insurance | Life insuranceSenior-level Full TimeNew York, NY17h ago
-
Staff Software Engineer, Storage USD 188K-275KC++ | CRDs | CSI | Ceph | Crash Consistency401k employer match | Employee stock purchase program ESPP | Flexible PTO | Flexible spending account | Health savings accountSenior-level Full TimeSunnyvale, California17h ago
-
Staff Software Engineer, Storage USD 188K-275KBlock Storage | C++ | CSI | Caching | Ceph401k employer match | Casual work environment | Catered lunch | Employee stock purchase program ESPP | Flexible PTOSenior-level Full TimeBellevue, Washington17h ago
-
Senior Software Engineer, Storage (File & Block) USD 153K-224KC++ | CSI | ClickHouse | Database | Debugging401k match | Childcare support | Dental insurance | Disability insurance | Employee stock purchase programSenior-level Full TimeNewYork, NY17h ago
-
Senior Software Engineer, Storage (File & Block) USD 153K-224KC++ | CSI | ClickHouse | CockroachDB | Consistency401k employer match | Catered lunch | Childcare support | Company paid life insurance | Employee stock purchase programSenior-level Full TimeBellevue, Washington17h ago
-
Senior Software Engineer, Storage (File & Block) USD 153K-224KBlock Storage | C++ | CSI | ClickHouse | Distributed Systems401k match | Disability insurance | Flexible PTO | Health insurance | Life insuranceSenior-level Full TimeSunnyvale, California17h ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R21h ago
-
Adobe Analytics | Git | GitLab | JQuery | Java401k matching | Adoption Assistance | Disability insurance | Healthcare benefits | Life insuranceMid-level Full TimeIrving, TX, United States21h ago
-
Staff Data Eng, Data Systems, TCGplayer USD 136K-228KAccess Control | Change Data Capture | Cost Management | Data Capture | Data Governance401k eligibility | Medical benefits | Paid time off | Parental leave | Remote work not available for U S visa sponsorshipSenior-level Full TimeRemote Oregon, United States R21h ago
-
Senior Data Engineer USD 140K-180KAPI Development | AWS | Airflow | Autogen | Azure401k plan with matching company contributionsSenior-level Full TimeUSA-CORP Westmont IL-Westmont - 700 Oakmont, …21h ago
-
Senior AI Engineer USD 124K-146KAWS | Agentic Workflows | ArgoCD | Azure | Azure DataDental insurance | Disability insurance | Flexible spending accounts | Health insurance | Health savings accountsSenior-level Full TimeCosta Mesa, California, USA, United States21h ago
-
Analytics Data Engineer USD 100K-120KAWS | Artificial Intelligence | Automation Scripting | Azure | CI/CD401k matching | All-hands meetings | Cell phone reimbursement | Dental insurance | FSA accountSenior-level Full TimeUnited States - Remote R21h ago
-
Big Data Application Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseRemote workSenior-level Full TimeUnited States - Remote R21h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R21h ago
-
Data Engineer USD 72K-130KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R21h ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionRemote workSenior-level Full TimeUnited States - Remote R21h ago
-
ML Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Remote workMid-level Full TimeUnited States - Remote R21h ago