This is, what the -map option is for. In the simplest form you just select one after another stream from the sources with the form <file>:<stream>. So for example to select the first stream from the first input file, use 0:0.

See https://ffmpeg.org/ffmpeg.html#toc-Advanced-options.