autorenew
Anza Unveils Jetstreamer: Revolutionizing Solana Data Access at 2.7M TPS

Anza Unveils Jetstreamer: Revolutionizing Solana Data Access at 2.7M TPS

In the fast-paced world of Solana, where meme tokens launch and evolve at breakneck speeds, having quick access to historical data can make all the difference for developers and researchers. That's why the recent announcement from Anza about their new tool, Jetstreamer, is turning heads. Shared via a tweet from SolanaFloor, this release promises to stream all Solana transactions and blocks since the network's genesis at an astonishing rate of over 2.7 million transactions per second (TPS). For anyone building or analyzing meme tokens on Solana, this could be a game-changer.

Jetstreamer GitHub repository screenshot showing high TPS capabilities

What is Jetstreamer?

Jetstreamer is a high-throughput toolkit designed specifically for Solana. It pulls historical chain data from Project Yellowstone's Old Faithful archive—a massive, open-source collection of every block and transaction on Solana mainnet from day one. Think of it as a supercharged replay button for the blockchain, allowing you to index, research, or backfill data in real-time without the hassle of running a full node.

Unlike traditional methods that might bog down your system, Jetstreamer is built for speed. It doesn't re-execute transactions; instead, it streams them in their already-processed state, just as they appeared originally. This makes it perfect for diving into Solana's history, especially for tracking the wild rides of meme tokens across epochs.

Key Features That Stand Out

Let's break down what makes Jetstreamer so powerful:

  • Blazing-Fast Streaming: Achieving over 2.7M TPS isn't just a brag—it's backed by robust hardware recommendations like a 64-core CPU and a 30 Gbps network. With better setups, you could push even higher speeds.

  • Plugin System: At its core, Jetstreamer uses a trait-based framework where you can build custom plugins. These observe events like epochs, blocks, transactions, rewards, and even leader-skipped blocks. It's flexible enough for simple logging or complex data analysis.

  • ClickHouse Integration: It comes with built-in support for ClickHouse, a speedy column-oriented database. You can spawn a local server or connect to an existing one, making it easy to store and query massive datasets. Batching data in chunks (like every 1,000 slots) helps avoid slowdowns.

  • Parallel Processing: By splitting work across multiple threads (set via environment variables like JETSTREAMER_THREADS), it processes slot ranges efficiently. Just note that the output order might not be strictly sequential, so design your downstream systems accordingly.

  • Epoch Compatibility: It covers all epochs from Solana's genesis. Early epochs (0-156) might have limitations with modern plugins, and compute unit tracking kicks in from epoch 450 onward. But for meme token hunters, this means you can analyze trends from the network's earliest days.

The tool is written in Rust and available on GitHub, complete with detailed docs and examples on docs.rs.

How Jetstreamer Works Under the Hood

Getting started is straightforward. Clone the repo, and you're ready to roll with Cargo commands. For a quick test, replay transactions from a specific epoch like this:

JETSTREAMER_THREADS=8 cargo run --release -- 800

This command processes epoch 800 using 8 threads. Or specify a slot range for more precision:

JETSTREAMER_THREADS=8 cargo run --release -- 358560000:367631999

Behind the scenes, Jetstreamer downloads and replays compressed archives from Old Faithful. It uses async callbacks to feed data into your plugins, where you can handle transactions or blocks as they stream in. For instance, a simple logging plugin might print transaction signatures and slots, while a more advanced one could track program interactions—super useful for spotting patterns in meme token deployments.

One thing to watch: It doesn't include account updates or transaction logs yet (those are planned for future projects). But for backfilling and research, it's already a powerhouse.

Why This Matters for Meme Token Enthusiasts

Solana is meme token central, with projects popping up daily. Jetstreamer's speed lets developers and analysts sift through historical data faster than ever. Imagine querying past transactions to study pump-and-dump patterns, track wallet behaviors, or even backfill data for new indexing services. Tools like this lower the barrier for building sophisticated apps, whether you're creating a meme token dashboard or researching market trends.

Community reactions are buzzing too. One reply to the announcement quipped, "That's a lot of Solana history to binge!" while another highlighted, "2.7M TPS. Just Solana things." It captures the excitement—Solana's ecosystem is all about innovation and speed.

If you're a blockchain practitioner eyeing meme tokens, Jetstreamer could supercharge your workflow. Head over to the repo and give it a spin. Who knows what insights you'll uncover in Solana's vast ledger?

You might be interested