Senior Data Engineer (Apache Spark)
Tasks
- Build distributed data processing solutions
- Build highly loaded database solutions
- Collaborate with cross-functional teams
- Conduct code reviews
- Create and implement technical solutions
- Define code standards and guidelines
- Estimate project tasks
- Implement data engineering solutions for financial reporting
- Implement data engineering solutions for marketing optimization
- Implement data engineering solutions for product analytics
- Implement data engineering solutions for reporting
- Investigate technical challenges
- Lead functional and architectural design
- Manage technical risks and mitigation
- Provide guidance to development team
- Resolve crisis situations
- Support project planning
Perks/Benefits
Skills/Tech-stack
Apache Spark | Asset bundles | Code review | Databricks (asset) | Databricks Asset Bundles | Linux | Performance optimization | Query performance | Query performance optimization | Spark SQL | Spark Structured Streaming | Structured Streaming | Terraform
Education
N/A
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R9d ago
-
Databricks Pipeline Architect USD 150K-180KAWS Glue | AWS Lambda | AWS S3 | Agile | Amazon Web ServicesPublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R7h ago
-
Research Engineer, FAIR AI & Society USD 117K-173KAI alignment | Apache Hive | Apache Spark | Artificial Intelligence | DPOEntry-level Full TimeMenlo Park, CA | New York, …12h ago
-
Software Engineer, Audio Embedded DSP - Reality Labs USD 117K-173KAndroid | Audio Processing | Audio Software | Audio software engineering | C#Mid-level Full TimeSunnyvale, CA12h ago
-
Software Engineer, Systems USD 221K-240KAlgorithms | CSS | Data Analysis | Data Modeling | Data ProcessingEntry-level Full TimeBellevue, WA12h ago
-
API Development | Accessible technology | Algorithms | Code Quality | Code reviewSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Senior Software Engineer, AI and Infrastructure USD 174K-252KArtificial Intelligence | C++ | Code review | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Software Engineer - Robot Link Platform USD 160K-232KAPI Design | Apache | Caching | Cloud services | DatabasesMid-level Full TimeFoster City, CA20h ago
-
Senior-level Full TimeSan Jose, CA20h ago
-
Senior Software Engineer - Data Platform USD 186K-218KAccess Control | Airflow | Apache Kafka | Apache Spark | CachingSenior-level Full TimeRemote - USA R21h ago
-
Software Engineer - Reference Data (Java/SQL) USD 175K-200KAPI Development | Distributed Systems | Git | HBase | HadoopMid-level Full TimeNew York21h ago
-
Senior-level Full TimeHybrid (Salt Lake City, UT, US) R22h ago
-
Robotics Hardware Integration Engineer USD 120K-158KAWS IoT | AWS IoT Core | AWS IoT Greengrass | C++ | CANDirect impact on shipped products | Early-stage company | Equity | Health, dental, and vision insurance | Permissive time off policyMid-level Full TimeAtlanta, Georgia, United States - Remote R23h ago
-
Lead AI Engineer (ML Ops) USD 116K-170KAPI Development | AWS | Azure | CI/CD | Cloud services401k match | Charity match | Employee assistance program | Employee stock purchase plan | Health and wellness allowanceSenior-level Full TimeIrving - 6011 Connection, United States23h ago
-
Senior-level Full TimeMcLean, VA, United States23h ago
-
AWS | CI/CD | Cloud platform | Database Administration | Google CloudSenior-level ContractSunnyvale, CA23h ago
-
Senior-level Full TimeRedmond, WA, US1d ago
-
DevOps Engineer, Infrastructure & Security USD 236K-295KAWS | Azure | Azure DevOps | Bash | CI/CDCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY1d ago
-
AI, Data & Technology - AI-ML Engineer USD 112K-179KAWS | Apache Spark | Azure | BigQuery | CI/CDHybrid work model | In person work two days per week | Travel up to 40 percentSenior-level Full TimeChicago, IL, United States1d ago
-
Alteryx | Apache Spark | Data Mining | Data Querying | Data analyticsBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersMid-level Full TimeWilmington, DE, United States1d ago
-
Staff Analytics Engineer - Foundational Data USD 194K-240KAirflow | Apache Spark | Business Intelligence | Data Modeling | Data ProcessingEmployee travel credits | Remote eligibleSenior-level Full TimeUnited States1d ago
-
Staff Software Engineer, Ads Data Platform USD 221K-279KApache Airflow | Apache Spark | Big Data | DBT | DatabricksAnnual equity refresh grants | Equity grants | Flexible work location | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Software Engineer, Storage Platform USD 153K-230KAWS | Alerting | Connection pooling | Containers | Encryption in Transit401k matching | Catered meals | Company holidays | Employer-paid disability insurance | Employer-paid life insuranceSenior-level Full TimeBellevue, WA1d ago
-
Senior Data Engineer - Data Science USD 125K-206KApache Hive | Apache Spark | D3.js | Data Engineering | Data GovernanceHealth and wellness programs | Hybrid work | Time awaySenior-level Full TimeMountain View, CA, United States1d ago
-
AWS | AWS S3 | AWS SQS | Apache Airflow | Apache Kafka401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD1d ago