How to handle file upload via GET and POST requests?

Question

linux

Good afternoon, there was a need to make a server that accepts files via GET and POST requests and saves them to a specific folder with normal names. There is an implementation of such a server in python, but there are questions about the performance of the server and its reliability. I want to do something like this on nginx or any other industrial web server. Do I understand correctly that I need to write some kind of backend?
In general, I know nothing about this, and I ask you to direct me to the right path of excavation. I read a lot of things, but none of what I read worked, and something is very outdated.

Answer 1

You can get by with nginx alone (using lua-nginx-module):

nginx_upload.conf

pid        logs/nginx_upload.pid;
events {
    worker_connections  1024;
}

http {
    lua_package_path '/usr/local/lib/lua/5.1/?.lua;;';

    server {
        listen       8001;

        # download
        autoindex on;
        autoindex_exact_size off;
        autoindex_localtime on;

        # auth
        auth_basic "Restricted site";
        auth_basic_user_file /opt/nginx/.htpasswd;

        location /download {
            alias upload;
        }


        location ~ ^/upload_lua(/.*)?$ {
            set $store_path upload$1/;
            content_by_lua_file conf/lua/my_upload.lua;
        }

        location ~ ^/delete/(.*)$ {
            set $file_path upload/$1;
            content_by_lua_file conf/lua/my_delete.lua;
        }
    }
}

https://www.yanxurui.cc/posts/server/2017-03-21-NG...

local upload = require "resty.upload"

local function my_get_file_name(header)
    local file_name
    for i, ele in ipairs(header) do
        file_name = string.match(ele, 'filename="(.*)"')
        if file_name and file_name ~= '' then
            return file_name
        end
    end
    return nil
end

local chunk_size = 4096
local form = upload:new(chunk_size)
local file
local file_path
while true do
    local typ, res, err = form:read()

    if not typ then
         ngx.say("failed to read: ", err)
         return
    end

    if typ == "header" then
        local file_name = my_get_file_name(res)
        if file_name then
            file_path = ngx.var.store_path..file_name
            file = io.open(file_path, "w+")
            if not file then
                ngx.say("failed to open file ", file_path)
                return
            end
        end

    elseif typ == "body" then
        if file then
            file:write(res)
        end

    elseif typ == "part_end" then
        if file then
            file:close()
            file = nil
            ngx.say("upload to "..file_path.." successfully!")
        end
    elseif typ == "eof" then
        break

    else
        -- do nothing
    end
end

Answer 2

Yes, in any case, you will need Backend and it doesn’t matter what language it will be in, it matters how many files and what size you need to accept - you will have to set the size limit, in PHP it is 50 megabytes by default, in python it is a different value. Perhaps the Python script will have to be connected via the wsgi layer to Apache or Nginx.