You can manually bulk upload stock quantities in Setup->WooCommerce tab:

Build a query Sku!= (SKU not equal to blank, which means all SKUs)