Cloudera Engineer

WE ARE

StartupSoft connects top Ukrainian engineers with world-class startups from Silicon Valley and EU. Our developers work directly on the product as an integral part of the startup team.

We are seeking a hands-on Cloudera Administrator with 4–6 years of on-prem experience to install, configure, upgrade, and fully administer both CDP Private Cloud Base and Cloudera Data Services end-to-end, including Cloudera Data Warehouse (CDW), Cloudera Data Engineering (CDE), and Cloudera AI (CAI). The role requires strong expertise in High Availability, Kerberos enablement, Cloudera Auto-TLS / TLS certificate management,

STACK ON THE PROJECT

BigQuery SQL, GCP, TypeScript, Cloud Run

STAGE

live

TEAM

Startupsoft side – 1 full-stack, 4 mobile, 2 QAs, 1 UI/UX designer. Client’s side – ~30 people

REQUIREMENTS

• 4–6 years of hands-on Cloudera on-prem administration (CDP Private Cloud Base strongly preferred).
• Proven ability to install and administer Cloudera Data Services (CDW/CDE/CAI) end-to-end (not only support).
• Strong Cloudera Manager experience (install, upgrade, troubleshoot, performance tuning).
• Strong experience enabling/operating High Availability (HA) in Cloudera/Hadoop ecosystems.
• Strong experience enabling/operating Kerberos (principals/keytabs lifecycle and troubleshooting).
• Strong experience enabling/operating TLS, including Cloudera Auto-TLS and certificate lifecycle management.
• Hands-on experience with Ranger (policies, audits, troubleshooting).
• Hands-on experience with Ranger KMS and HDFS TDE (encryption zones, key lifecycle).
• Experience integrating with external HSM / enterprise KMS (PKI, cert chains, trust configuration).
• Strong Linux administration and troubleshooting skills. Preferred / Nice to Have
• Practical experience with Kubernetes administration (networking/ingress, storage classes, certificates, observability) supporting Cloudera Data Services.
• Strong performance tuning for Hive/Impala/YARN workloads.  Familiarity with compliance controls (dual control, break-glass access, audit evidence).

RESPONSIBILITIESCDP Private Cloud Base – Full Administration

• Install, configure, operate, upgrade, and patch CDP Private Cloud Base (repositories, parcels, service roles, configuration baselines).
• Administer and support core components: HDFS, YARN, Hive, Impala, Hue, Kafka, Zookeeper, Ranger, Atlas (as applicable).
• Perform capacity planning, performance tuning, node provisioning/decommissioning, and advanced troubleshooting (logs/metrics/OS-level).

Cloudera Data Services – Installation + Full Administration (Critical)

• Install and configure Cloudera Data Services on the target platform, including prerequisites and platform readiness.
• Perform end-to-end administration of: 1. CDW: creation/operations of Virtual Warehouses, workload isolation, autoscaling/resource allocation, connectivity, performance tuning and troubleshooting. 2. CDE: environment setup, job execution operations, quotas, scheduling/monitoring, dependency/runtime management, and troubleshooting. 3. Cloudera AI (CAI): workspace setup, runtimes, user onboarding/support, and alignment with enterprise security controls.
• Own day-2 operations for Data Services: upgrades, scaling, backups (where applicable), monitoring/alerting, and incident/RCA.

High Availability (HA) & Resilience

• Implement and maintain HA for critical services (as applicable): NameNode HA, ResourceManager HA, HiveServer2 HA, and resilient Kafka/Zookeeper patterns.
• Validate failover behavior and maintain operational runbooks and SOPs.

Security: Kerberos, Auto-TLS, Ranger, KMS/HSM

• Lead Kerberos enablement and ongoing administration (principals, keytabs lifecycle, renewals, troubleshooting authentication issues).
• Enable and manage TLS at scale, including Cloudera Auto-TLS, certificate lifecycle management (keystores/truststores), trust chains, and secure service-to-service communications.
• Administer Ranger access controls (resource-based and tag-based policies), auditing, and ecosystem integrations; support governance via Atlas (as needed).
• Install/configure and operate Ranger KMS and HDFS Transparent Data Encryption (TDE) (encryption zones, key rotation, access policies, audits).
• Integrate Ranger KMS with external HSM / enterprise KMS (vendor-agnostic), ensuring secure key custody, compliance alignment, and auditability.

Operations & Automation

• Operate monitoring and alerting (Cloudera Manager and enterprise tools), manage incidents and RCAs, and drive permanent fixes.
• Maintain documentation, runbooks, change management, and standard maintenance processes.
• Automate repeatable operational tasks using Bash/Python (and optionally Ansible/Terraform where applicable).