dedupeByKey()

dedupeByKey<T>(key, fn): Promise<T>

Queues functions by key to prevent duplicate concurrent executions.

💎 Why is this a Hidden Gem?

Prevents duplicate concurrent execution. If 5 components invoke an operation with the same key, only 1 is executed and the result is shared.

remarque

Concurrent calls with the same key share a single execution. Key is released on completion.

---

Type Parameters

T: T

The return type of the function.

---

Parameters

key: string

Unique key for the operation.

fn: () => Promise<T>

The async function to execute.

---

Returns: Promise<T>

Promise that resolves to the function result.

---

Throws

Rejects if the queued function rejects.

---

Since

1.1.0

---

Performance

Uses Map for O(1) key lookup to prevent duplicate concurrent executions.

---

Also known as

❌ (Lodash, es-toolkit, Remeda, Radashi, Ramda, Effect, Modern Dash, Antfu)

---

Example

// Both return same result, but fetchUser is called once
const user1 = dedupeByKey('user-123', () => fetchUser('123'));
const user2 = dedupeByKey('user-123', () => fetchUser('123'));

// Different keys execute independently
const userA = dedupeByKey('user-A', () => fetchUser('A'));
const userB = dedupeByKey('user-B', () => fetchUser('B'));

---

How it works?

Prevents duplicate concurrent executions for the same key. Multiple calls with identical keys share a single execution — the key is released on completion.

Different Keys Execute Independently

---

Use Cases

Prevent duplicate API calls 📌

Queue API calls by key to prevent multiple identical requests from being made simultaneously. Essential for avoiding race conditions and reducing unnecessary network traffic.

#prevent#duplicate#deduplication#concurrent#cache#optimization

// Prevent duplicate user fetches
const getUserData = async (userId: string) => {
  return await dedupeByKey(`user-${userId}`, async () => {
    const response = await fetch(`/api/users/${userId}`);
    return response.json();
  });
};

// Multiple calls with same userId will only make one API request
const user1 = await getUserData("123");
const user2 = await getUserData("123");
const user3 = await getUserData("123");
// Only one API call is made, all return the same result

Manage resource loading efficiently

Prevent duplicate resource loading operations to optimize performance. Critical for image loading, heavy computations, or cache warming.

#manage#resources#loading#cache#performance#optimization

// Prevent duplicate cache operations
const getCachedData = async (cacheKey: string) => {
  return await dedupeByKey(`cache-${cacheKey}`, async () => {
    let data = await cache.get(cacheKey);
    if (!data) {
      data = await expensiveOperation();
      await cache.set(cacheKey, data);
    }
    return data;
  });
};

Shared initialization across modules

Ensure expensive setup runs only once even when triggered from multiple entry points. Perfect for lazy singletons, connection pools, or SDK initialization.

#shared#initialization#singleton#setup#connection#modules

const getDatabase = () => {
  return dedupeByKey("db-connection", async () => {
    console.log("Connecting to database...");
    const connection = await createConnection(config);
    await connection.runMigrations();
    return connection;
  });
};

// Called from multiple modules simultaneously
const [db1, db2, db3] = await Promise.all([
  getDatabase(), // From user-service
  getDatabase(), // From order-service  
  getDatabase(), // From notification-service
]);

// "Connecting to database..." logged only once
// db1 === db2 === db3 (same instance)