Can I download PDFs in bulk from the Paperpile interface?

Not at the moment. PDFs can be downloaded individually from the Paperpile interface, or in bulk directly from Google Drive.

In Google Drive, files are organized in subfolders sorted alphabetically by the first author's last name. For easier export, you can change how files are organized and named from the top right corner of your library by clicking the Drive icon > Configure...