U -e/@sHddlmZmZddlmZddlmZddlmZGdddeZ d S) )CallableOptional)Features) Generator)AbstractDatasetInputStreamc sDeZdZdeeeeeeeeee dfdd Z ddZ Z S) GeneratorDatasetInputStreamNF) generatorfeatures cache_dirkeep_in_memory streaming gen_kwargsnum_procc  s<tjf|||||d|tf||||d||_dS)N)r r r rr)r r r r)super__init__rbuilder) selfr r r r rrrkwargs __class__V/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/datasets/io/generator.pyr s" z$GeneratorDatasetInputStream.__init__cCsV|jr|jjdd}ns