1

Pyramid 2018 Model - File too big

Is there a limit on file size in the full version? I have the Enterprise 30 Day trial and I'm trying to build a model with a CSV file of over a million rows. It errors when I try to upload it.

7 replies

null
    • Strawberry_Button
    • 6 yrs ago
    • Reported - view

    I've modified the file to have around 550K rows and still too big. I hope this isn't an issue in the full version.

    • Senior Director of Product
    • Ian_Macdonald
    • 6 yrs ago
    • Reported - view

    Hi Missy,

    When you install Pyramid 2018, by default the file upload size is limited to 100MB. You can change this in the Admin console under Settings/File Upload.

     

    The maximum file size is 500MB. this is because http file transfer does not perform brilliantly and tends to overwhelm the web server if the files are too big or there are many people uploading.

    The other route is to use the "Shared File Location" option in the data model for your source csv file. In this scenario, you make directory on a file server accessible to both you and the P2018 Server (or rather the identity that is running the server) and copy your files into that location. The P2018 server can then read the files directly without going through the http file transfer protocol.

    This is also the approach to take if your CSV file gets updated and you want the model build to be scheduled and rebuild with the updated CSV file on  a regular basis.

    Hope that helps.

    Ian

    • Dave_Fackler
    • 6 yrs ago
    • Reported - view

    Ian Macdonald In a multi-server environment (several web servers, router servers, runtime servers, task servers, etc.), which server identity needs access to the shared file (or URL if using URL access) location?

    Dave F.

    • Senior Director of Product
    • Ian_Macdonald
    • 6 yrs ago
    • Reported - view

    Hi Dave,

    For the shared file access, I'll check with our support team and get back to you.

    Meanwhile, I've had a look at the forthcoming 2018.04 release and the file upload limit has been increased to 1GB.

    Ian

    • Senior Director of Product
    • Ian_Macdonald
    • 6 yrs ago
    • Reported - view

    Dave Fackler  - The Runtime and Task Engines are the two Pyrmaid 2018 services that require access to the shared file location.

    • Dave_Fackler
    • 6 yrs ago
    • Reported - view

    Thanks Ian Macdonald -- can I assume that if those services are running using the Local System account (the default installation), then it would be the computer account that needs to be granted access (i.e., DOMAIN\SERVER$) and not some other account?

    Dave F.

    • Senior Director of Product
    • Ian_Macdonald
    • 6 yrs ago
    • Reported - view

    Dave Fackler Correct.

Content aside

  • Status Answered
  • 1 Likes
  • 6 yrs agoLast active
  • 7Replies
  • 53Views
  • 2 Following