Looks like concat is available as it's own module:

https://github.com/taobao/nginx-http-concat

and another attempt by someone else here:

https://github.com/lindsayevans/nginx-static-concat

But both of them rely on or accept client-side concat, I'd rather just do it server-side only for security/control.