Can't submit data

#1

I have been trying (and failing) to spin up a local instance of Gen3 using docker compose. I'm pretty sure I have everything set up correctly.

o smoke_test passes
o application appears to function
o login thru oAuth works
o created program and project
o updated user.yaml with program, project permissions
o created API key
o configured gen3-client

gen3-client upload --profile=vanetten --upload-path=/Users/vanetten/Desktop/test.png

You don't have permission to upload data, detailed error message: 500 Internal Server error has occurred! Please try again later

logs

fence-service | [Mon May 13 17:41:03.651241 2019] [wsgi:error] [pid 1503:tid 139734837204736] [remote 172.31.0.11:3220] ConnectionError: HTTPSConnectionPool(host='localhost', port=443): Max retries exceeded with url: /user/jwt/keys (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f16770d9710>: Failed to establish a new connection: [Errno 111] Connection refused',))
fence-service | [Mon May 13 17:41:03.651403 2019] [wsgi:error] [pid 1503:tid 139734837204736] [remote 172.31.0.11:3220] [2019-05-13 17:41:03,651] ERROR in error_handler: 500 HTTP error occured. ID: 71e0351c-61b2-40bf-9fc8-104a4f423d8a
fence-service | [Mon May 13 17:41:03.651436 2019] [wsgi:error] [pid 1503:tid 139734837204736] [remote 172.31.0.11:3220] Details: {'message': MaxRetryError("HTTPSConnectionPool(host='localhost', port=443): Max retries exceeded with url: /user/jwt/keys (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f16770d9710>: Failed to establish a new connection: [Errno 111] Connection refused',))",)}
revproxy-service | 172.31.0.1 - - [13/May/2019:17:41:03 +0000] "POST /user/data/upload HTTP/1.1" 500 3132 "-" "Go-http-client/1.1" "-"
fence-service | {"gen3log": "apache2", "date_access": "[13/May/2019:17:41:03 +0000]", "user_id": "-", "request_id": "-", "session_id": "-", "visitor_id": "-", "network_client_ip": "-", "network_bytes_write": "3132", "http_response_time": "0", "http_status_code": "500", "http_request": "/data/upload", "http_verb": "POST", "http_referer": "-", "http_useragent": "Go-http-client/1.1", "message": "POST /data/upload HTTP/1.0"}
fence-service | [Mon May 13 17:41:03.660360 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] [2019-05-13 17:41:03,660] ERROR in error_handler: Catch exception
fence-service | [Mon May 13 17:41:03.660399 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] Traceback (most recent call last):
fence-service | [Mon May 13 17:41:03.660409 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/usr/local/lib/python2.7/dist-packages/flask/app.py", line 1612, in full_dispatch_request
fence-service | [Mon May 13 17:41:03.660419 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] rv = self.dispatch_request()
fence-service | [Mon May 13 17:41:03.660429 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/usr/local/lib/python2.7/dist-packages/flask/app.py", line 1598, in dispatch_request
fence-service | [Mon May 13 17:41:03.660439 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] return self.view_functionsrule.endpoint
fence-service | [Mon May 13 17:41:03.660448 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/src/authutils/authutils/token/validate.py", line 245, in wrapper
fence-service | [Mon May 13 17:41:03.661794 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] set_current_token(validate_request(aud=aud, purpose=purpose))
fence-service | [Mon May 13 17:41:03.661831 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/src/authutils/authutils/token/validate.py", line 222, in validate_request
fence-service | [Mon May 13 17:41:03.661843 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] return validate_jwt(encoded_token, aud, purpose)
fence-service | [Mon May 13 17:41:03.661875 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/src/authutils/authutils/token/validate.py", line 194, in validate_jwt
fence-service | [Mon May 13 17:41:03.662329 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] attempt_refresh=attempt_refresh
fence-service | [Mon May 13 17:41:03.662338 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/src/authutils/authutils/token/keys.py", line 171, in get_public_key_for_token
fence-service | [Mon May 13 17:41:03.662347 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] return get_public_key(kid, iss=iss, attempt_refresh=attempt_refresh)
fence-service | [Mon May 13 17:41:03.662355 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/src/authutils/authutils/token/keys.py", line 141, in get_public_key
fence-service | [Mon May 13 17:41:03.662370 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] refresh_jwt_public_keys(iss)
fence-service | [Mon May 13 17:41:03.662768 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/src/authutils/authutils/token/keys.py", line 86, in refresh_jwt_public_keys
fence-service | [Mon May 13 17:41:03.662777 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] jwt_public_keys = requests.get(path).json()['keys']
fence-service | [Mon May 13 17:41:03.662783 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 75, in get
fence-service | [Mon May 13 17:41:03.662791 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] return request('get', url, params=params, **kwargs)
fence-service | [Mon May 13 17:41:03.662801 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 60, in request
fence-service | [Mon May 13 17:41:03.662811 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] return session.request(method=method, url=url, **kwargs)
fence-service | [Mon May 13 17:41:03.662821 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 533, in request
fence-service | [Mon May 13 17:41:03.663306 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] resp = self.send(prep, **send_kwargs)
fence-service | [Mon May 13 17:41:03.663341 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 646, in send
fence-service | [Mon May 13 17:41:03.663351 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] r = adapter.send(request, **kwargs)
fence-service | [Mon May 13 17:41:03.663362 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 516, in send
fence-service | [Mon May 13 17:41:03.663372 2019] [wsgi:error] [pid 1503:tid 139734820402944] [remote 172.31.0.11:54667] raise ConnectionError(e, request=request)

#2

Hi Bill_Van_Etten!

Compose services currently do not support gen3-client.

#3

Actually, let me check this information, I will get back to you soon.

#4

Thank you for your prompt response. I (BioTeam, bioteam.net) have been working with most ICs from the NIH to help guide them toward trans-NIH solutions for commons, auth, and data index, etc that span CSPs. Gen3 appears to be a good fit. Have spoken with folks from NCI and Kid's First who seem to love Gen3. I'm simply trying to get a private instance running, either locally or on AWS, such that I can kick the tires and figure out what's all included. After trying for several days, I can't seem to get a fully functional system going with compose-services. I'm about to try cloud-automation, but I imagine I might hit even more pitfalls. Any chance I can get a one-on-one meeting with someone?

#5

Hi @Bill_Van_Etten! We are trying to reproduce that compose-services error. Its probably just a configuration error that we can fix.

For cloud-automation, we are about to provide updates that will make it easier for 3rd party (non-UChicago) folks to run. I expect that it a couple of weeks.

We are happy to schedule a one-on-one meeting as well. Are you on our slack in our #gen3-community channel?

#6

I would like to get to know Gen3 better. I am generally available for a one-on-one meeting this week or next (vanetten@bioteam.net), please suggest a time. I have joined the Gen3 forum (forums.gen3.org), but I have not joined any slack channels outside of my workspace. I will investigate that.

Bill

#7

Hi @Bill_Van_Etten! We sent you an invitation to the slack channel.