Senior Software Engineer - Data Platform
Tasks
- Build data catalogs and metadata services
- Build data replication systems
- Create orchestration and platform automation
- Design data ingestion systems
- Develop developer tooling for data access
- Develop internal libraries and APIs
- Implement data processing reliability and observability
- Improve scalability and security
- Operate data lakehouse infrastructure
Perks/Benefits
Skills/Tech-stack
AWS Lambda | AWS RDS | Airflow | Amundsen | Apache Hive | Apache Hive Metastore | Apache Spark | CloudFormation | Dagster | Databricks | Datahub | Delta Lake | Docker | DynamoDB | Go | Hive Metastore | Hudi | Iceberg | Java | Kinesis | Kubernetes | Prefect | Python | S3 | SQS | Scala | Terraform | Unity Catalog
Education
N/A
Related jobs
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R8h ago
-
Machine Learning Engineer USD 140K-190KApache Flink | Apache Kafka | Apache Spark | Bigtable | CI/CDMid-level Full TimeRemote - USA R11h ago
-
Senior Embedded Software Engineer - Future Forward USD 153K-201KAgile | Authentication | Board Bring-up | Bring-up | C#Senior-level Full TimeSunnyvale, CA, United States R12h ago
-
Member of Technical Staff (Storage) USD 185K-200KAI Assisted Development | C++ | Concurrency Control | Data replication | Distributed SystemsDental insurance | Flexible time off | Life and disability insurance | Medical insurance | Mental wellbeing benefitsSenior-level Full TimeNew York, NY R13h ago
-
Audio ML Engineer II USD 160K-210KAudio Processing | Benchmarking | Classification | DET Curves | Deep learning401k | Commuter benefits | Company offsite | Daily in office lunch | Dental and visionMid-level Full TimeGlobal Remote R15h ago
-
Staff AI Engineer (Audio) USD 185K-235KAudio Processing | Classification metrics | Data Drift | Data analytics | Datadog401k | Commuter benefits | Company offsite | Daily lunch | Dental/visionSenior-level Full TimeGlobal Remote R15h ago
-
Data Engineer- Hybrid Onsite Des Moines, Iowa USD 87K-123KApache Spark | Azure Databricks | Azure DevOps | Bash | Data Mapping401k match | Health insurance | Hybrid work | Lifestyle spending account | LinkedIn Learning accessMid-level Full TimeDes Moines, Iowa, United States R16h ago
-
Senior Data Engineer (Remote) USD 155KAgile | Apache Spark | BigQuery | Cassandra | Data Governance401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible scheduleSenior-level Full TimeWork From Home, United States R17h ago
-
Senior AI Operations Engineer USD 170K-180KAI infrastructure | Azure | CI/CD | Cloud infrastructure | Container Engine for Kubernetes401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Flexible spending accountSenior-level Full TimeWork From Home, United States R17h ago
-
Sr. Machine Learning Engineer USD 175K-220KAWS | Adversarial Machine Learning | Anti-spoofing | Attack detection | CI/CDIn person meeting during hiring | Remote work flexibilitySenior-level Full TimeUnited States R18h ago
-
Data Engineer USD 89K-167KAmazon S3 | Apache Airflow | Apache Spark | DBT | Data ModelingDental insurance | Health insurance | Vision insuranceMid-level Full TimeRemote, USA R19h ago
-
Senior Data Engineer | Bankrate USD 100K-210KAPIs | AWS Lambda | AWS S3 | Airflow | Amazon EC2401k matching | Eastern Standard Time schedule | Employee assistance program | Flexible paid time off | Flexible spending accountsSenior-level Full TimeUnited States R19h ago
-
Software Engineer USD 149K-211KAlgorithms | C# | C++ | Cause analysis | Code reviewBonus | Equity | Health benefits | Hybrid scheduleMid-level Full TimeMountain View, CA, USA R22h ago
-
Data Engineer USD 123K-151KC++ | Cloud platform | Data Migration | Data Modeling | Data PartitioningBenefits | Hybrid scheduleMid-level Full TimeAustin, TX, USA R22h ago
-
Software Engineer USD 149K-211KAlgorithms | C# | C++ | Code review | Data AnalysisBenefits | Bonuses | Equity | Hybrid work scheduleMid-level Full TimeMountain View, CA, USA R22h ago
-
Software Engineer USD 149K-211KAlgorithms | Android Development | C# | C++ | Data StructuresHybrid scheduleMid-level Full TimeMountain View, CA, USA R22h ago
-
Software Engineer USD 149K-211KAlgorithms | C# | C++ | Code review | Data AnalysisBonus | Equity | Hybrid work scheduleMid-level Full TimeMountain View, CA, USA R22h ago
-
Software Engineer USD 149K-211KC# | C++ | Cause analysis | Data Processing | Data StructuresHybrid scheduleMid-level Full TimeSunnyvale, CA, USA R22h ago
-
Software Engineer USD 149K-211KAlgorithms | C# | C++ | Cause analysis | Data AnalysisHybrid scheduleMid-level Full TimeMountain View, CA, USA R22h ago
-
Research Engineer USD 147K-211KAlgorithm Design | C++ | Experimental Design | JAX | Machine LearningHybrid scheduleMid-level Full TimeMountain View, CA, USA R22h ago
-
Senior Research Engineer USD 174K-252KC plus plus | Code Reviews | Data Curation | Deep learning | JAXHybrid scheduleSenior-level Full TimeNew York, NY, USA R22h ago
-
Staff Software Engineer USD 264K-300KAdversarial Testing | Algorithm Design | C++ | Data Pipelines | Data StructuresBonus | Equity | Hybrid scheduleSenior-level Full TimeMountain View, CA, USA R22h ago
-
Staff Software Engineer USD 207K-300KAdversarial Testing | C++ | Data pipeline | Learning evaluation | Machine LearningEquity compensation | Health benefits | Hybrid scheduleSenior-level Full TimeNew York, NY, USA R22h ago
-
Senior Research Engineer USD 174K-252KC plus plus | Cause analysis | Code Reviews | Dataset curation | Deep Neural NetworksBenefits | Bonus | Equity | Hybrid work scheduleSenior-level Full TimeMountain View, CA, USA R22h ago
-
Software Engineer USD 147K-211KAlgorithms | C# | C++ | Cause analysis | Data AnalysisHybrid work scheduleMid-level Full TimeNew York, NY, USA R22h ago