Senior Data Engineer
Austin Technical Center - Austin Technical Center, United States
USD 125K-173K Senior-level Full Time
Tasks
- Automate infrastructure with Terraform
- Build and maintain batch and streaming jobs with Databricks
- Build data engineering pipelines and backend services
- Deploy and manage services on Azure Kubernetes Service
- Design and develop microservices with Java
- Design and optimize relational data models and databases
- Develop real time data processing with Kafka and event hub
- Drive engineering best practices and documentation
- Implement CI/CD pipelines with GitHub Actions
- Implement cron and event driven orchestration services
- Implement observability with Prometheus and Datadog
- Manage GitOps deployments with ArgoCD
- Optimize performance reliability and scalability
- Troubleshoot production issues and perform root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
AKS | ArgoCD | Azure | Azure Event | Azure Event Hub | Azure Kubernetes | Azure Kubernetes Service | CI/CD | Databricks | Datadog | Docker | Event Driven | Event Hub | Event-driven architecture | GitHub Actions | GitOps | Infrastructure as Code | Java | Kafka | Kubernetes | Kubernetes Service | Load Testing | Microservices | Observability | Performance Tuning | PostgreSQL | Prometheus | Quarkus | Query Optimization | REST APIs | Relational databases | SLI | SLO | Schema Design | Spring Boot | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Engineering in Software Engineering | Bachelor of Science | Bachelor of Science in Computer Science
Roles
Backend | Backend Developer | Data Engineer | Developer | Engineer | Software Engineer
Related jobs
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R11h ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R11h ago
-
Senior DevOps Engineer ID63545 USD 135K-185KAWS | Apache Airflow | ArgoCD | Azure | BigQueryFlextime | Growth roadmaps | Mentorship | Office work options | Remote work optionsSenior-level Full TimeMiami, United States12h ago
-
BigQuery | Curriculum Development | Data Governance | Data Lakehouse | Data ModelingAsynchronous hiring process | Part-time hoursSenior-level Part TimeBoston, US13h ago
-
Software Engineer Level 2-FFPP-8863 USD 78K-250KAccumulo | BSON | Bigtable | Distributed File System | File System401k match | Employee referral programs | Flexible spending accounts | Inclusive workplace culture | Medical/Dental/Vision insuranceMid-level Full TimeHanover, MD13h ago
-
Senior Director, AI / Machine Learning Software Engineer USD 136K-300KApache Flink | Apache Spark | CI/CD | Data Lineage | Data PrivacyHealth benefits | Paid leave | Paid volunteer timeSenior-level Full TimeNew York, NY, United States14h ago
-
Artificial Intelligence | C++ | CSS | Data Storage | Distributed ComputingSenior-level Full TimeNew York, NY, USA15h ago
-
Customer Engineer, Data Analytics, Google Cloud USD 153K-222KBatch Processing | Big Data | Cloud Architecture | Cloud platform | Customer RequirementsSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Algorithms | C++ | Cloud Computing | Cloud platform | Data StructuresSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KC++ | Capacity Planning | Cloud Databases | Data Migration | Data PipelinesTravel up to 30 percentMid-level Full TimeReston, VA, USA15h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeDiversity and Inclusion Commitment | Flexible asynchronous culture | Laid-back atmosphere | Portfolio and LinkedIn supportMid-level Full TimeBellevue, WA, USA21h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Flexible management | Remote-friendly, distributed teamMid-level Full TimeDenver, CO, USA21h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimePalo Alto, CA, USA21h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible work environment | Remote-friendlyMid-level Full TimeLos Angeles, CA, USA21h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Flexible remote workMid-level Full TimeKirkland, WA, USA21h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible remote work | Work on impact driven productsMid-level Full TimeSan Jose, CA, USA21h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly work environment | Portfolio and LinkedIn submission flexibility | Remote-friendly environmentMid-level Full TimeCupertino, CA, USA21h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Portfolio supportMid-level Full TimeOakland, CA, USA21h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Bonus | Competitive salary | Equity | Laid-back atmosphereMid-level Full TimeSilver Spring, MD, USA21h ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible management | Friendly work environment | Portfolio supportMid-level Full TimeMadison, WI, USA21h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Remote/distributed workMid-level Full TimeChapel Hill, NC, USA21h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Opportunity to make impactMid-level Full TimeNashville, TN, USA21h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Portfolio support | Remote-friendlyMid-level Full TimeOrlando, FL, USA21h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive compensation | Friendly work environment | Opportunity for impact | Remote/distributed teamMid-level Full TimeJacksonville, FL, USA21h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible management approach | Friendly work environmentMid-level Full TimeJersey City, NJ, USA21h ago