Principal Architect

As a Principal Architect, you will be responsible for the architectural design and end-to-end implementation of a high-performance OLAP query engine and semantic layer. The primary goal is to develop a custom JSON-based query language (DSL) and a translation engine that converts these requests into optimized SQL for columnar databases. This role requires a deep understanding of systems programming, compiler theory, and multi-dimensional data modeling to serve high-concurrency read loads in a microservices environment.

- Architectural Design & Query Execution

- Compiler & DSL development: Design a custom JSON-based OLAP query language. Define eBNF grammars and build a translation layer to convert functional formulas and DSL requests into an optimized execution plan.

- SQL generation & optimization: Implement and oversee the generation of highly optimized SQL tailored for columnar databases including ClickHouse, SingleStore, and DuckDB.

- Semantic layer management: Architect the representation of multi-dimensional data models within columnar structures, ensuring efficient data retrieval and aggregation.

- Custom function logic: Implement logic for custom functions, determining the optimal balance between SQL push-down and application-layer execution

- Caching & Performance Engineering

- Multi-dimensional caching: Envisage and implement a distributed caching strategy for multidimensional data, utilizing shared memory systems like Redis.

- Concurrency & scaling: Build and maintain high-performance microservices using Java (Micronaut or Spring Boot) with Project Loom (Virtual Threads) to handle massive concurrent read loads.

- Low-level optimization: Manage system-level performance including connection pooling, array pooling, and off-heap memory management.

- JVM tuning: Apply expert knowledge of Java Garbage Collectors (including ZGC and Shenandoah) to maintain low-latency response times.

- Engineering Excellence & AI Integration

- AI-augmented development: Leverage AI coding agents and tools to accelerate the software development lifecycle, from prototyping to debugging.

- Technical documentation: Maintain a disciplined approach to software development by documenting architectural decisions, design patterns, and technical specifications.