Company: GoAhead Consulting Limited
Location: Remote (Work from Home)
Job Type: Contractor (12-Month Contract)
Job Location: Riyadh, Saudi Arabia
Overview:
GoAhead Consulting Limited is seeking an experienced Kafka (Confluent) Admin Consultant for a remote project in Saudi Arabia. This is a 12-month contract with potential extensions until the project is completed. The ideal candidate will have in-depth expertise in managing Kafka clusters, both on-premise and in the cloud, and be comfortable working remotely while adhering to Saudi Standard Time.
Key Responsibilities:
- Kafka Administration: Install, configure, and administer Confluent Kafka clusters in cloud and on-premise environments.
- Monitoring & Alerts: Set up monitoring using tools like Prometheus, Grafana, and Confluent Control Center to track cluster performance.
- Cluster Scaling: Plan and implement horizontal and vertical scaling of Kafka clusters to manage data throughput and storage.
- Security Management: Implement security protocols including SSL/TLS encryption, Kerberos, and role-based access control (RBAC).
- Backup & Recovery: Develop backup, disaster recovery, and failover strategies to ensure data integrity.
- Performance Tuning: Optimize Kafka components (brokers, ZooKeeper, producers, consumers) to improve performance and reduce latency.
- Kafka Connect & Stream Processing: Manage Kafka Connect and optimize Kafka Streams for real-time data processing.
- Cluster Upgrades: Plan and execute upgrades and patches for Kafka brokers and Confluent components.
- Automation: Use scripting languages like Bash, Python, or automation tools like Ansible to streamline Kafka operations.
- Kafka Topics Management: Create and manage Kafka topics, partitions, and replication settings to ensure resource efficiency.
- Troubleshooting: Diagnose and resolve Kafka issues related to performance, ZooKeeper synchronization, consumer groups, and message delays.
- Data Governance & Auditing: Implement governance and audit logging for Kafka topics and streams.
- Collaboration: Work with development and DevOps teams to ensure smooth Kafka-based application integration.
- Documentation: Maintain updated documentation for Kafka environments, procedures, and incident response plans.
Required Skills:
- Kafka Expertise: In-depth experience with Apache Kafka and the Confluent Platform (Kafka Streams, Kafka Connect, Schema Registry).
- Confluent Tools: Experience with Confluent-specific tools (Control Center, Schema Registry, REST Proxy).
- ZooKeeper Administration: Solid understanding of ZooKeeper for Kafka cluster management.
- Performance Optimization: Expertise in optimizing Kafka brokers, producers/consumers, and managing topics/partitions.
- Scripting & Automation: Proficiency in Bash, Python, and automation tools like Ansible.
- Security: Strong understanding of Kafka security configurations (SSL/TLS, SASL/Kerberos, RBAC).
- Cloud Deployments: Experience with Kafka cluster deployments in cloud environments (AWS, Azure, GCP) and Kubernetes.
- Troubleshooting: Ability to troubleshoot Kafka performance and consumer-lag issues.
- Data Integration: Experience with Kafka Connect and integrating data sources and sinks.
- Monitoring & Logging: Experience with Kafka monitoring tools (Prometheus, Grafana, ELK stack).
Job Details:
- Contract Duration: 12 months, with potential for extension.
- Location: Remote (Work from Home).
- Working Hours: Full-time, aligned with Saudi Standard Time.
- Salary: Unspecified (to be discussed).
How to Apply:
Job Link
Contact Page
https://www.goaheadconsulting.co.uk/contact-us#uae
If you need an explanation on writing your CV, Cover Letter and Email Template or help applying speak to Happy Face