Concurrent Loader

Works just like the GenericLoader but concurrently for those who choose to optimize their workflow.

from langchain_community.document_loaders import ConcurrentLoader

API Reference:ConcurrentLoader

loader = ConcurrentLoader.from_filesystem("example_data/", glob="**/*.txt")

files = loader.load()

len(files)